Jul 24 17:43:12 user nova-compute[70375]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 24 17:43:14 user nova-compute[70375]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70375) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 17:43:14 user nova-compute[70375]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70375) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 17:43:14 user nova-compute[70375]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70375) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 17:43:14 user nova-compute[70375]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:43:15 user nova-compute[70375]: INFO nova.virt.driver [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 24 17:43:15 user nova-compute[70375]: INFO nova.compute.provider_config [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Acquiring lock "singleton_lock" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Acquired lock "singleton_lock" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Releasing lock "singleton_lock" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Full set of CONF: {{(pid=70375) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ******************************************************************************** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Configuration options gathered from: {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ================================================================================ {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] allow_resize_to_same_host      = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] arq_binding_timeout            = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] backdoor_port                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] backdoor_socket                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] block_device_allocate_retries  = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] block_device_allocate_retries_interval = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cert                           = self.pem {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute_monitors               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] config_dir                     = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] config_drive_format            = iso9660 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] config_source                  = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] console_host                   = user {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] control_exchange               = nova {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cpu_allocation_ratio           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] daemon                         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] debug                          = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] default_access_ip_network_name = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] default_availability_zone      = nova {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] default_ephemeral_format       = ext4 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] default_schedule_zone          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] disk_allocation_ratio          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] enable_new_services            = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] enabled_apis                   = ['osapi_compute'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] enabled_ssl_apis               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] flat_injected                  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] force_config_drive             = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] force_raw_images               = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] graceful_shutdown_timeout      = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] heal_instance_info_cache_interval = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] host                           = user {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_build_timeout         = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_delete_interval       = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_format                = [instance: %(uuid)s]  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_name_template         = instance-%08x {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_usage_audit           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_usage_audit_period    = month {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] internal_service_availability_zone = internal {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] key                            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] live_migration_retry_count     = 30 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_config_append              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_dir                        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_file                       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_options                    = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_rotate_interval            = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_rotate_interval_type       = days {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] log_rotation_type              = none {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] long_rpc_timeout               = 1800 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_concurrent_builds          = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_concurrent_live_migrations = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_concurrent_snapshots       = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_local_block_devices        = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_logfile_count              = 30 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] max_logfile_size_mb            = 200 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] maximum_instance_delete_attempts = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metadata_listen                = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metadata_listen_port           = 8775 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metadata_workers               = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] migrate_max_retries            = -1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] mkisofs_cmd                    = genisoimage {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] my_ip                          = 10.0.0.210 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] network_allocate_retries       = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] osapi_compute_listen_port      = 8774 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] osapi_compute_unique_server_name_scope =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] osapi_compute_workers          = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] password_length                = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] periodic_enable                = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] periodic_fuzzy_delay           = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] pointer_model                  = ps2mouse {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] preallocate_images             = none {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] publish_errors                 = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] pybasedir                      = /opt/stack/nova {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ram_allocation_ratio           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rate_limit_burst               = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rate_limit_except_level        = CRITICAL {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rate_limit_interval            = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reboot_timeout                 = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reclaim_instance_interval      = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] record                         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reimage_timeout_per_gb         = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] report_interval                = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rescue_timeout                 = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reserved_host_cpus             = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reserved_host_disk_mb          = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reserved_host_memory_mb        = 512 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] reserved_huge_pages            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] resize_confirm_window          = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] resize_fs_using_block_device   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] resume_guests_state_on_host_boot = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rpc_response_timeout           = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] run_external_periodic_tasks    = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] running_deleted_instance_action = reap {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] running_deleted_instance_poll_interval = 1800 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] running_deleted_instance_timeout = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler_instance_sync_interval = 120 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_down_time              = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] servicegroup_driver            = db {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] shelved_offload_time           = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] shelved_poll_interval          = 3600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] shutdown_timeout               = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] source_is_ipv6                 = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ssl_only                       = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] state_path                     = /opt/stack/data/nova {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] sync_power_state_interval      = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] sync_power_state_pool_size     = 1000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] syslog_log_facility            = LOG_USER {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] tempdir                        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] timeout_nbd                    = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] transport_url                  = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] update_resources_interval      = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_cow_images                 = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_eventlog                   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_journal                    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_json                       = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_rootwrap_daemon            = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_stderr                     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] use_syslog                     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vcpu_pin_set                   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plugging_is_fatal          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plugging_timeout           = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] virt_mkfs                      = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] volume_usage_poll_interval     = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] watch_log_file                 = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] web                            = /usr/share/spice-html5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_concurrency.disable_process_locking = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.auth_strategy              = keystone {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.compute_link_prefix        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.dhcp_domain                = novalocal {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.enable_instance_password   = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.glance_link_prefix         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.instance_list_per_project_cells = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.list_records_by_skipping_down_cells = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.local_metadata_per_cell    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.max_limit                  = 1000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.metadata_cache_expiration  = 15 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.neutron_default_tenant_id  = default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.use_forwarded_for          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.use_neutron_default_nets   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_dynamic_targets = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_jsonfile_path   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.backend                  = dogpile.cache.memcached {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.backend_argument         = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.config_prefix            = cache.oslo {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.dead_timeout             = 60.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.debug_cache_backend      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.enable_retry_client      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.enable_socket_keepalive  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.enabled                  = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.expiration_time          = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.hashclient_retry_attempts = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_dead_retry      = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_password        =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_pool_maxsize    = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_sasl_enabled    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.memcache_username        =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.proxies                  = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.retry_attempts           = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.retry_delay              = 0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.socket_keepalive_count   = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.socket_keepalive_idle    = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.socket_keepalive_interval = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.tls_allowed_ciphers      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.tls_cafile               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.tls_certfile             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.tls_enabled              = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cache.tls_keyfile              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.auth_section            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.auth_type               = password {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.cafile                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.certfile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.collect_timing          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.cross_az_attach         = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.debug                   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.endpoint_template       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.http_retries            = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.insecure                = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.keyfile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.os_region_name          = RegionOne {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.split_loggers           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cinder.timeout                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.cpu_dedicated_set      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.cpu_shared_set         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.image_type_exclude_list = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.max_concurrent_disk_ops = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.max_disk_devices_to_attach = -1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.resource_provider_association_refresh = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.shutdown_retry_interval = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] conductor.workers              = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] console.allowed_origins        = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] console.ssl_ciphers            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] console.ssl_minimum_version    = default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] consoleauth.token_ttl          = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.cafile                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.certfile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.collect_timing          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.connect_retries         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.connect_retry_delay     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.endpoint_override       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.insecure                = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.keyfile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.max_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.min_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.region_name             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.service_name            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.service_type            = accelerator {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.split_loggers           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.status_code_retries     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.timeout                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] cyborg.version                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.backend               = sqlalchemy {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.connection            = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.connection_debug      = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.connection_parameters =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.connection_recycle_time = 3600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.connection_trace      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.db_inc_retry_interval = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.db_max_retries        = 20 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.db_max_retry_interval = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.db_retry_interval     = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.max_overflow          = 50 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.max_pool_size         = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.max_retries           = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.mysql_enable_ndb      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.mysql_wsrep_sync_wait = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.pool_timeout          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.retry_interval        = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.slave_connection      = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] database.sqlite_synchronous    = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.backend           = sqlalchemy {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.connection        = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.connection_debug  = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.connection_parameters =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.connection_recycle_time = 3600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.connection_trace  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.db_inc_retry_interval = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.db_max_retries    = 20 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.db_max_retry_interval = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.db_retry_interval = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.max_overflow      = 50 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.max_pool_size     = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.max_retries       = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.mysql_enable_ndb  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.pool_timeout      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.retry_interval    = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.slave_connection  = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] api_database.sqlite_synchronous = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] devices.enabled_mdev_types     = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ephemeral_storage_encryption.enabled = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.api_servers             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.cafile                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.certfile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.collect_timing          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.connect_retries         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.connect_retry_delay     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.debug                   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.default_trusted_certificate_ids = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.enable_certificate_validation = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.enable_rbd_download     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.endpoint_override       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.insecure                = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.keyfile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.max_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.min_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.num_retries             = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.rbd_ceph_conf           =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.rbd_connect_timeout     = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.rbd_pool                =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.rbd_user                =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.region_name             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.service_name            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.service_type            = image {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.split_loggers           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.status_code_retries     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.timeout                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.verify_glance_signatures = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] glance.version                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] guestfs.debug                  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.config_drive_cdrom      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.config_drive_inject_password = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.enable_instance_metrics_collection = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.enable_remotefx         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.instances_path_share    =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.iscsi_initiator_list    = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.limit_cpu_features      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.power_state_check_timeframe = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.use_multipath_io        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.volume_attach_retry_count = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.vswitch_name            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] mks.enabled                    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.manager_interval   = 2400 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.precache_concurrency = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.remove_unused_base_images = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] image_cache.subdirectory_name  = _base {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.api_max_retries         = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.api_retry_interval      = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.auth_section            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.auth_type               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.cafile                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.certfile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.collect_timing          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.connect_retries         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.connect_retry_delay     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.endpoint_override       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.insecure                = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.keyfile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.max_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.min_version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.partition_key           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.peer_list               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.region_name             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.serial_console_state_timeout = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.service_name            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.service_type            = baremetal {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.split_loggers           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.status_code_retries     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.timeout                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ironic.version                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] key_manager.fixed_key          = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.barbican_api_version  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.barbican_endpoint     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.barbican_endpoint_type = public {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.barbican_region_name  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.cafile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.certfile              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.collect_timing        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.insecure              = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.keyfile               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.number_of_retries     = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.retry_delay           = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.send_service_user_token = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.split_loggers         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.timeout               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.verify_ssl            = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican.verify_ssl_path       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.auth_section = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.auth_type = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.cafile   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.certfile = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.collect_timing = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.insecure = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.keyfile  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.split_loggers = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] barbican_service_user.timeout  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.approle_role_id          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.approle_secret_id        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.cafile                   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.certfile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.collect_timing           = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.insecure                 = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.keyfile                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.kv_mountpoint            = secret {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.kv_version               = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.namespace                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.root_token_id            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.split_loggers            = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.ssl_ca_crt_file          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.timeout                  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.use_ssl                  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.cafile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.certfile              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.collect_timing        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.connect_retries       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.connect_retry_delay   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.endpoint_override     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.insecure              = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.keyfile               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.max_version           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.min_version           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.region_name           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.service_name          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.service_type          = identity {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.split_loggers         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.status_code_retries   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.timeout               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] keystone.version               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.connection_uri         =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_mode               = custom {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: WARNING oslo_config.cfg [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_power_governor_high = performance {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_power_governor_low = powersave {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_power_management   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.device_detach_attempts = 8 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.device_detach_timeout  = 20 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.disk_cachemodes        = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.disk_prefix            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.enabled_perf_events    = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.file_backed_memory     = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.gid_maps               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.hw_disk_discard        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.hw_machine_type        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_rbd_glance_store_name =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_rbd_pool        = rbd {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_type            = default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.images_volume_group    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.inject_key             = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.inject_partition       = -2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.inject_password        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.iscsi_iface            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.iser_use_multipath     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_bandwidth = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_downtime = 500 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_inbound_addr = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_permit_post_copy = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_scheme  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_timeout_action = abort {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_tunnelled = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: WARNING oslo_config.cfg [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 24 17:43:15 user nova-compute[70375]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 24 17:43:15 user nova-compute[70375]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 24 17:43:15 user nova-compute[70375]: and ``live_migration_inbound_addr`` respectively.
Jul 24 17:43:15 user nova-compute[70375]: ).  Its value may be silently ignored in the future.
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.live_migration_with_native_tls = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.max_queues             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.nfs_mount_options      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_memory_encrypted_guests = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_pcie_ports         = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.pmem_namespaces        = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.quobyte_client_cfg     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rbd_secret_uuid        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rbd_user               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.remote_filesystem_transport = ssh {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rescue_image_id        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rescue_kernel_id       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rescue_ramdisk_id      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.rx_queue_size          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.smbfs_mount_options    =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.snapshot_compression   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.snapshot_image_format  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.sparse_logical_volumes = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.swtpm_enabled          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.swtpm_group            = tss {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.swtpm_user             = tss {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.sysinfo_serial         = unique {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.tb_cache_size          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.tx_queue_size          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.uid_maps               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.use_virtio_for_bridges = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.virt_type              = kvm {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.volume_clear           = zero {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.volume_clear_size      = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.volume_use_multipath   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_cache_path   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.vzstorage_mount_user   = stack {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.auth_section           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.auth_type              = password {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.cafile                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.certfile               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.collect_timing         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.connect_retries        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.connect_retry_delay    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.default_floating_pool  = public {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.endpoint_override      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.extension_sync_interval = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.http_retries           = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.insecure               = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.keyfile                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.max_version            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.min_version            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.ovs_bridge             = br-int {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.physnets               = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.region_name            = RegionOne {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.service_metadata_proxy = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.service_name           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.service_type           = network {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.split_loggers          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.status_code_retries    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.timeout                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] neutron.version                = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] notifications.bdms_in_notifications = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] notifications.default_level    = INFO {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] notifications.notification_format = unversioned {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] notifications.notify_on_state_change = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] pci.alias                      = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] pci.device_spec                = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] pci.report_in_placement        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.auth_section         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.auth_type            = password {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.cafile               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.certfile             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.collect_timing       = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.connect_retries      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.connect_retry_delay  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.default_domain_id    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.default_domain_name  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.domain_id            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.domain_name          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.endpoint_override    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.insecure             = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.keyfile              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.max_version          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.min_version          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.password             = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.project_domain_id    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.project_domain_name  = Default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.project_id           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.project_name         = service {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.region_name          = RegionOne {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.service_name         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.service_type         = placement {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.split_loggers        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.status_code_retries  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.system_scope         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.timeout              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.trust_id             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.user_domain_id       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.user_domain_name     = Default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.user_id              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.username             = placement {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] placement.version              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.cores                    = 20 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.count_usage_from_placement = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.injected_file_content_bytes = 10240 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.injected_file_path_length = 255 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.injected_files           = 5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.instances                = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.key_pairs                = 100 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.metadata_items           = 128 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.ram                      = 51200 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.recheck_quota            = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.server_group_members     = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] quota.server_groups            = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rdp.enabled                    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.image_metadata_prefilter = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.max_attempts         = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.max_placement_results = 1000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.query_placement_for_availability_zone = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.query_placement_for_image_type_support = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] scheduler.workers              = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.host_subset_size = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.isolated_hosts = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.isolated_images = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.pci_in_placement = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.track_instance_changes = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metrics.required               = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metrics.weight_multiplier      = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] metrics.weight_setting         = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.enabled         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.port_range      = 10000:20000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] serial_console.serialproxy_port = 6083 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.auth_section      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.auth_type         = password {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.cafile            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.certfile          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.collect_timing    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.insecure          = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.keyfile           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.send_service_user_token = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.split_loggers     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] service_user.timeout           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.agent_enabled            = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.enabled                  = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.html5proxy_port          = 6082 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.image_compression        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.jpeg_compression         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.playback_compression     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.server_listen            = 127.0.0.1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.streaming_mode           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] spice.zlib_compression         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] upgrade_levels.baseapi         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] upgrade_levels.cert            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] upgrade_levels.compute         = auto {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] upgrade_levels.conductor       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] upgrade_levels.scheduler       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.auth_section = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.auth_type = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.cafile = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.certfile = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.insecure = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.keyfile = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vendordata_dynamic_auth.timeout = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.api_retry_count         = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.ca_file                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.cache_prefix            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.cluster_name            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.connection_pool_size    = 10 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.console_delay_seconds   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.datastore_regex         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.host_ip                 = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.host_password           = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.host_port               = 443 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.host_username           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.insecure                = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.integration_bridge      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.maximum_objects         = 100 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.pbm_default_policy      = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.pbm_enabled             = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.pbm_wsdl_location       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.serial_port_proxy_uri   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.serial_port_service_uri = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.task_poll_interval      = 0.5 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.use_linked_clone        = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.vnc_keymap              = en-us {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.vnc_port                = 5900 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vmware.vnc_port_total          = 10000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.auth_schemes               = ['none'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.enabled                    = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.novncproxy_port            = 6080 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.server_listen              = 0.0.0.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.vencrypt_ca_certs          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.vencrypt_client_cert       = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vnc.vencrypt_client_key        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.disable_rootwrap   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.enable_numa_live_migration = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.libvirt_disable_apic = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.client_socket_timeout     = 900 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.default_pool_size         = 1000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.keep_alive                = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.max_header_line           = 16384 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.ssl_ca_file               = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.ssl_cert_file             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.ssl_key_file              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.tcp_keepidle              = 600 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] zvm.ca_file                    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] zvm.cloud_connector_url        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] zvm.reachable_timeout          = 300 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.enforce_new_defaults = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.enforce_scope      = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.policy_default_rule = default {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.policy_file        = policy.yaml {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.connection_string     = messaging:// {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.enabled               = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.es_doc_type           = notification {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.es_scroll_size        = 10000 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.es_scroll_time        = 2m {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.filter_error_trace    = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.hmac_keys             = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.sentinel_service_name = mymaster {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.socket_timeout        = 0.1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.trace_requests        = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler.trace_sqlalchemy      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler_jaeger.process_tags   = {} {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler_jaeger.service_name_prefix = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] profiler_otlp.service_name_prefix = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] remote_debug.host              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] remote_debug.port              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_notifications.retry = -1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.auth_section        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.auth_type           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.cafile              = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.certfile            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.collect_timing      = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.connect_retries     = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.connect_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.endpoint_id         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.endpoint_override   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.insecure            = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.keyfile             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.max_version         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.min_version         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.region_name         = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.service_name        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.service_type        = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.split_loggers       = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.status_code_retries = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.status_code_retry_delay = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.timeout             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.valid_interfaces    = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_limit.version             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_reports.file_event_handler = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] oslo_reports.log_dir           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.group  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] vif_plug_ovs_privileged.user   = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.flat_interface = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.isolate_vif         = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_vif_ovs.per_port_bridge     = False {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] os_brick.lock_path             = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.capabilities   = [21] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.group          = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.helper_command = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] privsep_osbrick.user           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.group           = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.helper_command  = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] nova_sys_admin.user            = None {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG oslo_service.service [None req-e62fc678-4c59-47cb-8070-78e9c29299ff None None] ******************************************************************************** {{(pid=70375) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 24 17:43:15 user nova-compute[70375]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Starting native event thread {{(pid=70375) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Starting green dispatch thread {{(pid=70375) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Starting connection event dispatch thread {{(pid=70375) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Connecting to libvirt: qemu:///system {{(pid=70375) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe6528c33d0> {{(pid=70375) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe6528c33d0> {{(pid=70375) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 24 17:43:15 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Connection event '1' reason 'None'
Jul 24 17:43:15 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 17:43:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.mount [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Initialising _HostMountState generation 0 {{(pid=70375) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 24 17:43:23 user nova-compute[70375]: INFO nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host capabilities <capabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <host>
Jul 24 17:43:23 user nova-compute[70375]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 24 17:43:23 user nova-compute[70375]:     <cpu>
Jul 24 17:43:23 user nova-compute[70375]:       <arch>x86_64</arch>
Jul 24 17:43:23 user nova-compute[70375]:       <model>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <microcode version='1070'/>
Jul 24 17:43:23 user nova-compute[70375]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='osxsave'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='invtsc'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='rsba'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature name='skip-l1dfl-vmentry'/>
Jul 24 17:43:23 user nova-compute[70375]:       <pages unit='KiB' size='4'/>
Jul 24 17:43:23 user nova-compute[70375]:       <pages unit='KiB' size='2048'/>
Jul 24 17:43:23 user nova-compute[70375]:     </cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <power_management>
Jul 24 17:43:23 user nova-compute[70375]:       <suspend_mem/>
Jul 24 17:43:23 user nova-compute[70375]:       <suspend_disk/>
Jul 24 17:43:23 user nova-compute[70375]:       <suspend_hybrid/>
Jul 24 17:43:23 user nova-compute[70375]:     </power_management>
Jul 24 17:43:23 user nova-compute[70375]:     <iommu support='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <migration_features>
Jul 24 17:43:23 user nova-compute[70375]:       <live/>
Jul 24 17:43:23 user nova-compute[70375]:       <uri_transports>
Jul 24 17:43:23 user nova-compute[70375]:         <uri_transport>tcp</uri_transport>
Jul 24 17:43:23 user nova-compute[70375]:         <uri_transport>rdma</uri_transport>
Jul 24 17:43:23 user nova-compute[70375]:       </uri_transports>
Jul 24 17:43:23 user nova-compute[70375]:     </migration_features>
Jul 24 17:43:23 user nova-compute[70375]:     <topology>
Jul 24 17:43:23 user nova-compute[70375]:       <cells num='2'>
Jul 24 17:43:23 user nova-compute[70375]:         <cell id='0'>
Jul 24 17:43:23 user nova-compute[70375]:           <memory unit='KiB'>8140616</memory>
Jul 24 17:43:23 user nova-compute[70375]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 24 17:43:23 user nova-compute[70375]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 17:43:23 user nova-compute[70375]:           <distances>
Jul 24 17:43:23 user nova-compute[70375]:             <sibling id='0' value='10'/>
Jul 24 17:43:23 user nova-compute[70375]:             <sibling id='1' value='20'/>
Jul 24 17:43:23 user nova-compute[70375]:           </distances>
Jul 24 17:43:23 user nova-compute[70375]:           <cpus num='6'>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 24 17:43:23 user nova-compute[70375]:           </cpus>
Jul 24 17:43:23 user nova-compute[70375]:         </cell>
Jul 24 17:43:23 user nova-compute[70375]:         <cell id='1'>
Jul 24 17:43:23 user nova-compute[70375]:           <memory unit='KiB'>8255068</memory>
Jul 24 17:43:23 user nova-compute[70375]:           <pages unit='KiB' size='4'>2063767</pages>
Jul 24 17:43:23 user nova-compute[70375]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 17:43:23 user nova-compute[70375]:           <distances>
Jul 24 17:43:23 user nova-compute[70375]:             <sibling id='0' value='20'/>
Jul 24 17:43:23 user nova-compute[70375]:             <sibling id='1' value='10'/>
Jul 24 17:43:23 user nova-compute[70375]:           </distances>
Jul 24 17:43:23 user nova-compute[70375]:           <cpus num='6'>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 24 17:43:23 user nova-compute[70375]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 24 17:43:23 user nova-compute[70375]:           </cpus>
Jul 24 17:43:23 user nova-compute[70375]:         </cell>
Jul 24 17:43:23 user nova-compute[70375]:       </cells>
Jul 24 17:43:23 user nova-compute[70375]:     </topology>
Jul 24 17:43:23 user nova-compute[70375]:     <cache>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 24 17:43:23 user nova-compute[70375]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 24 17:43:23 user nova-compute[70375]:     </cache>
Jul 24 17:43:23 user nova-compute[70375]:     <secmodel>
Jul 24 17:43:23 user nova-compute[70375]:       <model>apparmor</model>
Jul 24 17:43:23 user nova-compute[70375]:       <doi>0</doi>
Jul 24 17:43:23 user nova-compute[70375]:     </secmodel>
Jul 24 17:43:23 user nova-compute[70375]:     <secmodel>
Jul 24 17:43:23 user nova-compute[70375]:       <model>dac</model>
Jul 24 17:43:23 user nova-compute[70375]:       <doi>0</doi>
Jul 24 17:43:23 user nova-compute[70375]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 24 17:43:23 user nova-compute[70375]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 24 17:43:23 user nova-compute[70375]:     </secmodel>
Jul 24 17:43:23 user nova-compute[70375]:   </host>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='alpha'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>clipper</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='armv6l'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>spitz</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>nuri</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>kzm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>z2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>tosa</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n810</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>terrier</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>midway</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>microbit</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>verdex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>highbank</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>akita</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>connex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>collie</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='armv7l'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>spitz</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>nuri</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>kzm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>z2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>tosa</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n810</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>terrier</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>midway</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>microbit</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>verdex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>highbank</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>akita</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>connex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>collie</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='aarch64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>spitz</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>nuri</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>kzm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>z2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>tosa</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n810</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>n800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>terrier</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>midway</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>microbit</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>verdex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>raspi3b</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>highbank</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>akita</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>connex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>collie</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <acpi default='on' toggle='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='cris'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='i686'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>isapc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>microvm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='kvm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <pae/>
Jul 24 17:43:23 user nova-compute[70375]:       <nonpae/>
Jul 24 17:43:23 user nova-compute[70375]:       <acpi default='on' toggle='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:       <apic default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='m68k'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>an5206</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>q800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>next-cube</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='microblaze'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='microblazeel'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='mips'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>malta</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='mipsel'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>malta</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='mips64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>malta</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>pica61</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>magnum</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='mips64el'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>malta</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>pica61</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>magnum</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='16'>boston</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='ppc'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mac99</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>40p</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>taihu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='ppc64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>taihu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>40p</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mac99</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='ppc64le'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>taihu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>40p</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>mac99</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='riscv32'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='8'>spike</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>opentitan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='8'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='riscv64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='8'>spike</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>shakti_c</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='8'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='s390x'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='sh4'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>shix</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>r2d</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='sh4eb'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>shix</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>r2d</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='sparc'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>SS-5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>SS-20</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>LX</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>SS-4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>SS-10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>Voyager</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='sparc64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sun4u</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>niagara</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>sun4v</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='x86_64'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>64</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='1'>isapc</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>microvm</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='kvm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <acpi default='on' toggle='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:       <apic default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='xtensa'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>sim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>kc705</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ml605</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx200</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx60</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]:   <guest>
Jul 24 17:43:23 user nova-compute[70375]:     <os_type>hvm</os_type>
Jul 24 17:43:23 user nova-compute[70375]:     <arch name='xtensaeb'>
Jul 24 17:43:23 user nova-compute[70375]:       <wordsize>32</wordsize>
Jul 24 17:43:23 user nova-compute[70375]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='4'>sim</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>kc705</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ml605</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>virt</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx200</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>lx60</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 17:43:23 user nova-compute[70375]:       <domain type='qemu'/>
Jul 24 17:43:23 user nova-compute[70375]:     </arch>
Jul 24 17:43:23 user nova-compute[70375]:     <features>
Jul 24 17:43:23 user nova-compute[70375]:       <cpuselection/>
Jul 24 17:43:23 user nova-compute[70375]:       <deviceboot/>
Jul 24 17:43:23 user nova-compute[70375]:       <disksnapshot default='on' toggle='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     </features>
Jul 24 17:43:23 user nova-compute[70375]:   </guest>
Jul 24 17:43:23 user nova-compute[70375]: </capabilities>
Jul 24 17:43:23 user nova-compute[70375]: 
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-q35-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>i686</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='288'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'/>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='lm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-i440fx-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>i686</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='255'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'/>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='lm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ide</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-q35-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>i686</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='288'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'/>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='lm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-i440fx-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>i686</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='255'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'/>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='lm'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ide</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-q35-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>x86_64</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='288'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>efi</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='invtsc'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='rsba'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-i440fx-jammy</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>x86_64</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='255'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>efi</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='invtsc'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='rsba'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ide</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-q35-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>x86_64</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='288'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>efi</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='invtsc'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='rsba'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 24 17:43:23 user nova-compute[70375]: <domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 17:43:23 user nova-compute[70375]:   <domain>kvm</domain>
Jul 24 17:43:23 user nova-compute[70375]:   <machine>pc-i440fx-6.2</machine>
Jul 24 17:43:23 user nova-compute[70375]:   <arch>x86_64</arch>
Jul 24 17:43:23 user nova-compute[70375]:   <vcpu max='255'/>
Jul 24 17:43:23 user nova-compute[70375]:   <iothreads supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:   <os supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='firmware'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>efi</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:     <loader supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>rom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pflash</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='readonly'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>yes</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='secure'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>no</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </loader>
Jul 24 17:43:23 user nova-compute[70375]:   </os>
Jul 24 17:43:23 user nova-compute[70375]:   <cpu>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-passthrough' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='hostPassthroughMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='maximum' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='maximumMigratable'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>on</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>off</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='host-model' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <vendor>Intel</vendor>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ss'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='vmx'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pcid'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='hypervisor'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arat'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='umip'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='md-clear'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='invtsc'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibpb'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='ibrs'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-stibp'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='rsba'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='erms'/>
Jul 24 17:43:23 user nova-compute[70375]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:     <mode name='custom' supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>qemu64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>qemu32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>phenom</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>pentium</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>n270</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm64</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>kvm32</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>coreduo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>core2duo</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>athlon</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Westmere</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Snowridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Skylake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>SandyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Penryn</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G5</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G4</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G3</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Opteron_G2</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Opteron_G1</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>IvyBridge</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Icelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Haswell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Rome</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-Milan</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>EPYC</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Dhyana</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cooperlake</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>Conroe</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='no'>Broadwell</model>
Jul 24 17:43:23 user nova-compute[70375]:       <model usable='yes'>486</model>
Jul 24 17:43:23 user nova-compute[70375]:     </mode>
Jul 24 17:43:23 user nova-compute[70375]:   </cpu>
Jul 24 17:43:23 user nova-compute[70375]:   <memoryBacking supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:     <enum name='sourceType'>
Jul 24 17:43:23 user nova-compute[70375]:       <value>file</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>anonymous</value>
Jul 24 17:43:23 user nova-compute[70375]:       <value>memfd</value>
Jul 24 17:43:23 user nova-compute[70375]:     </enum>
Jul 24 17:43:23 user nova-compute[70375]:   </memoryBacking>
Jul 24 17:43:23 user nova-compute[70375]:   <devices>
Jul 24 17:43:23 user nova-compute[70375]:     <disk supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='diskDevice'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>disk</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cdrom</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>floppy</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>lun</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='bus'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ide</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>fdc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sata</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </disk>
Jul 24 17:43:23 user nova-compute[70375]:     <graphics supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='type'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>sdl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vnc</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>spice</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egl-headless</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </graphics>
Jul 24 17:43:23 user nova-compute[70375]:     <video supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='modelType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>cirrus</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>vmvga</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>qxl</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>none</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>bochs</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>ramfb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </video>
Jul 24 17:43:23 user nova-compute[70375]:     <hostdev supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='mode'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>subsystem</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='startupPolicy'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>default</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>mandatory</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>requisite</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>optional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='subsysType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>usb</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>pci</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>scsi</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='capsType'/>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='pciBackend'/>
Jul 24 17:43:23 user nova-compute[70375]:     </hostdev>
Jul 24 17:43:23 user nova-compute[70375]:     <rng supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtio-non-transitional</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>random</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>egd</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>builtin</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </rng>
Jul 24 17:43:23 user nova-compute[70375]:     <filesystem supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='driverType'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>path</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>handle</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>virtiofs</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </filesystem>
Jul 24 17:43:23 user nova-compute[70375]:     <tpm supported='yes'>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='model'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-tis</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>tpm-crb</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:       <enum name='backendModel'>
Jul 24 17:43:23 user nova-compute[70375]:         <value>passthrough</value>
Jul 24 17:43:23 user nova-compute[70375]:         <value>emulator</value>
Jul 24 17:43:23 user nova-compute[70375]:       </enum>
Jul 24 17:43:23 user nova-compute[70375]:     </tpm>
Jul 24 17:43:23 user nova-compute[70375]:   </devices>
Jul 24 17:43:23 user nova-compute[70375]:   <features>
Jul 24 17:43:23 user nova-compute[70375]:     <gic supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:     <vmcoreinfo supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <genid supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backingStoreInput supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <backup supported='yes'/>
Jul 24 17:43:23 user nova-compute[70375]:     <sev supported='no'/>
Jul 24 17:43:23 user nova-compute[70375]:   </features>
Jul 24 17:43:23 user nova-compute[70375]: </domainCapabilities>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70375) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70375) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Checking secure boot support for host arch (x86_64) {{(pid=70375) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 24 17:43:23 user nova-compute[70375]: INFO nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Secure Boot support detected
Jul 24 17:43:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] cpu compare xml: <cpu match="exact">
Jul 24 17:43:23 user nova-compute[70375]:   <model>Nehalem</model>
Jul 24 17:43:23 user nova-compute[70375]: </cpu>
Jul 24 17:43:23 user nova-compute[70375]:  {{(pid=70375) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 24 17:43:23 user nova-compute[70375]: INFO nova.virt.node [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Generated node identity 111dfe89-23fd-4eb8-8c78-beab50e50b4c
Jul 24 17:43:23 user nova-compute[70375]: INFO nova.virt.node [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Wrote node identity 111dfe89-23fd-4eb8-8c78-beab50e50b4c to /opt/stack/data/nova/compute_id
Jul 24 17:43:23 user nova-compute[70375]: WARNING nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Compute nodes ['111dfe89-23fd-4eb8-8c78-beab50e50b4c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 24 17:43:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 24 17:43:24 user nova-compute[70375]: WARNING nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 17:43:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:43:24 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:43:24 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Hypervisor/Node resource view: name=user free_ram=10871MB free_disk=25.18826675415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:43:24 user nova-compute[70375]: WARNING nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] No compute node record for user:111dfe89-23fd-4eb8-8c78-beab50e50b4c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 111dfe89-23fd-4eb8-8c78-beab50e50b4c could not be found.
Jul 24 17:43:24 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Compute node record created for user:user with uuid: 111dfe89-23fd-4eb8-8c78-beab50e50b4c
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:43:24 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [req-3a43985a-b2f5-4620-9053-abd830389ce3] Created resource provider record via placement API for resource provider with UUID 111dfe89-23fd-4eb8-8c78-beab50e50b4c and name user.
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70375) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 24 17:43:24 user nova-compute[70375]: INFO nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] kernel doesn't support AMD SEV
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Libvirt baseline CPU <cpu>
Jul 24 17:43:24 user nova-compute[70375]:   <arch>x86_64</arch>
Jul 24 17:43:24 user nova-compute[70375]:   <model>Nehalem</model>
Jul 24 17:43:24 user nova-compute[70375]:   <vendor>Intel</vendor>
Jul 24 17:43:24 user nova-compute[70375]:   <topology sockets="6" cores="1" threads="1"/>
Jul 24 17:43:24 user nova-compute[70375]: </cpu>
Jul 24 17:43:24 user nova-compute[70375]:  {{(pid=70375) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Updated inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Updating resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c generation from 0 to 1 during operation: update_inventory {{(pid=70375) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:43:24 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Updating resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c generation from 1 to 2 during operation: update_traits {{(pid=70375) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 17:43:25 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:43:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:43:25 user nova-compute[70375]: DEBUG nova.service [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Creating RPC server for service compute {{(pid=70375) start /opt/stack/nova/nova/service.py:182}}
Jul 24 17:43:25 user nova-compute[70375]: DEBUG nova.service [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Join ServiceGroup membership for this service compute {{(pid=70375) start /opt/stack/nova/nova/service.py:199}}
Jul 24 17:43:25 user nova-compute[70375]: DEBUG nova.servicegroup.drivers.db [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70375) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 24 17:44:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:44:15 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:44:15 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=10260MB free_disk=25.09225082397461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:44:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:45:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:45:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:45:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=25.137962341308594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:45:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:45:17 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:45:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:17 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:17 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:46:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:46:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=10207MB free_disk=24.911304473876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:46:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:47:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:17 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:19 user nova-compute[70375]: INFO nova.compute.claims [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Claim successful on node user
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Creating image(s)
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "/opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "/opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=9449MB free_disk=24.933330535888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.policy [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04cf2a8b04e14668861ec365938413d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba9d7ccdc734305a3a13267d64dfeaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d6e60f36-36c7-4a39-865c-43d902ef2a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:20 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.part --force-share --output=json" returned: 0 in 0.192s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG nova.virt.images [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] 43e95aac-d02a-49a8-aaa5-04490973ed39 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.part /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.part /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.converted" returned: 0 in 0.223s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.243s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:21 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiddogha4/privsep.sock']
Jul 24 17:47:22 user sudo[79554]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiddogha4/privsep.sock
Jul 24 17:47:22 user sudo[79554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 17:47:23 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Successfully created port: cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:47:24 user sudo[79554]: pam_unix(sudo:session): session closed for user root
Jul 24 17:47:24 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Spawned new privsep daemon via rootwrap
Jul 24 17:47:24 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 17:47:24 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 17:47:24 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 24 17:47:24 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79559
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.200s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk 1073741824" returned: 0 in 0.047s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Cannot resize image /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lazy-loading 'migration_context' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Successfully updated port: cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquired lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-changed-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Refreshing instance network info cache due to event network-changed-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:47:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] Acquiring lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updating instance_info_cache with network_info: [{"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Releasing lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Instance network_info: |[{"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] Acquired lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.network.neutron [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Refreshing network info cache for port cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Start _get_guest_xml network_info=[{"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:47:28 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:28 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-563552932',display_name='tempest-DeleteServersTestJSON-server-563552932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-563552932',id=1,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba9d7ccdc734305a3a13267d64dfeaf',ramdisk_id='',reservation_id='r-n037tumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1371215078',owner_user_name='tempest-DeleteServersTestJSON-1371215078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:20Z,user_data=None,user_id='04cf2a8b04e14668861ec365938413d9',uuid=d6e60f36-36c7-4a39-865c-43d902ef2a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converting VIF {"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:47:28 user nova-compute[70375]:   <uuid>d6e60f36-36c7-4a39-865c-43d902ef2a6b</uuid>
Jul 24 17:47:28 user nova-compute[70375]:   <name>instance-00000001</name>
Jul 24 17:47:28 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:47:28 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:47:28 user nova-compute[70375]:   <metadata>
Jul 24 17:47:28 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:47:28 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:name>tempest-DeleteServersTestJSON-server-563552932</nova:name>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:47:28</nova:creationTime>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:47:28 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:47:28 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:owner>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:user uuid="04cf2a8b04e14668861ec365938413d9">tempest-DeleteServersTestJSON-1371215078-project-member</nova:user>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:project uuid="7ba9d7ccdc734305a3a13267d64dfeaf">tempest-DeleteServersTestJSON-1371215078</nova:project>
Jul 24 17:47:28 user nova-compute[70375]:       </nova:owner>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:47:28 user nova-compute[70375]:       <nova:ports>
Jul 24 17:47:28 user nova-compute[70375]:         <nova:port uuid="cc3005cc-99d8-43e6-b0e8-1c67c9f2369c">
Jul 24 17:47:28 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 17:47:28 user nova-compute[70375]:         </nova:port>
Jul 24 17:47:28 user nova-compute[70375]:       </nova:ports>
Jul 24 17:47:28 user nova-compute[70375]:     </nova:instance>
Jul 24 17:47:28 user nova-compute[70375]:   </metadata>
Jul 24 17:47:28 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:47:28 user nova-compute[70375]:     <system>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="serial">d6e60f36-36c7-4a39-865c-43d902ef2a6b</entry>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="uuid">d6e60f36-36c7-4a39-865c-43d902ef2a6b</entry>
Jul 24 17:47:28 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:47:28 user nova-compute[70375]:     </system>
Jul 24 17:47:28 user nova-compute[70375]:   </sysinfo>
Jul 24 17:47:28 user nova-compute[70375]:   <os>
Jul 24 17:47:28 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:47:28 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:47:28 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:47:28 user nova-compute[70375]:   </os>
Jul 24 17:47:28 user nova-compute[70375]:   <features>
Jul 24 17:47:28 user nova-compute[70375]:     <acpi/>
Jul 24 17:47:28 user nova-compute[70375]:     <apic/>
Jul 24 17:47:28 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:47:28 user nova-compute[70375]:   </features>
Jul 24 17:47:28 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:47:28 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:47:28 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:47:28 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:47:28 user nova-compute[70375]:   </clock>
Jul 24 17:47:28 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:47:28 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:47:28 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:47:28 user nova-compute[70375]:   </cpu>
Jul 24 17:47:28 user nova-compute[70375]:   <devices>
Jul 24 17:47:28 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:47:28 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:47:28 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk"/>
Jul 24 17:47:28 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:47:28 user nova-compute[70375]:     </disk>
Jul 24 17:47:28 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:47:28 user nova-compute[70375]:       <mac address="fa:16:3e:62:64:a8"/>
Jul 24 17:47:28 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:28 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:47:28 user nova-compute[70375]:       <target dev="tapcc3005cc-99"/>
Jul 24 17:47:28 user nova-compute[70375]:     </interface>
Jul 24 17:47:28 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:47:28 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/console.log" append="off"/>
Jul 24 17:47:28 user nova-compute[70375]:     </serial>
Jul 24 17:47:28 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:47:28 user nova-compute[70375]:     <video>
Jul 24 17:47:28 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:28 user nova-compute[70375]:     </video>
Jul 24 17:47:28 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:47:28 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:47:28 user nova-compute[70375]:     </rng>
Jul 24 17:47:28 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:47:28 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:47:28 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:47:28 user nova-compute[70375]:     </memballoon>
Jul 24 17:47:28 user nova-compute[70375]:   </devices>
Jul 24 17:47:28 user nova-compute[70375]: </domain>
Jul 24 17:47:28 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-563552932',display_name='tempest-DeleteServersTestJSON-server-563552932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-563552932',id=1,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba9d7ccdc734305a3a13267d64dfeaf',ramdisk_id='',reservation_id='r-n037tumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1371215078',owner_user_name='tempest-DeleteServersTestJSON-1371215078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:20Z,user_data=None,user_id='04cf2a8b04e14668861ec365938413d9',uuid=d6e60f36-36c7-4a39-865c-43d902ef2a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converting VIF {"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG os_vif [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Created schema index Interface.name {{(pid=70375) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Created schema index Port.name {{(pid=70375) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Created schema index Bridge.name {{(pid=70375) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [POLLOUT] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:47:28 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4ripwe5d/privsep.sock']
Jul 24 17:47:28 user sudo[79581]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4ripwe5d/privsep.sock
Jul 24 17:47:28 user sudo[79581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 17:47:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:30 user sudo[79581]: pam_unix(sudo:session): session closed for user root
Jul 24 17:47:30 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Spawned new privsep daemon via rootwrap
Jul 24 17:47:30 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 17:47:30 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 17:47:30 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 24 17:47:30 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79586
Jul 24 17:47:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updated VIF entry in instance network info cache for port cc3005cc-99d8-43e6-b0e8-1c67c9f2369c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:47:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updating instance_info_cache with network_info: [{"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81914d23-3c78-4a7a-b6cd-d5f3873e05b3 req-5ba5ea94-b215-40c2-920c-3b7e3f6e2b55 service nova] Releasing lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc3005cc-99, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc3005cc-99, col_values=(('external_ids', {'iface-id': 'cc3005cc-99d8-43e6-b0e8-1c67c9f2369c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:64:a8', 'vm-uuid': 'd6e60f36-36c7-4a39-865c-43d902ef2a6b'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:31 user nova-compute[70375]: INFO os_vif [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99')
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] No VIF found with MAC fa:16:3e:62:64:a8, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:31 user nova-compute[70375]: INFO nova.compute.claims [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Claim successful on node user
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Creating image(s)
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.policy [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a4f4aec1664e07b1d57a7848c02498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2983b563c19040dfbec3b2c10ce2d14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.125s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk 1073741824" returned: 0 in 0.050s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Cannot resize image /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.objects.instance [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Ensure instance console log exists: /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:33 user nova-compute[70375]: INFO nova.compute.claims [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Claim successful on node user
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220854.2997217, d6e60f36-36c7-4a39-865c-43d902ef2a6b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] VM Resumed (Lifecycle Event)
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Instance spawned successfully.
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220854.396804, d6e60f36-36c7-4a39-865c-43d902ef2a6b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] VM Started (Lifecycle Event)
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Took 14.08 seconds to spawn the instance on the hypervisor.
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Creating image(s)
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Successfully created port: 0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:47:34 user nova-compute[70375]: INFO nova.compute.manager [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Took 15.41 seconds to build instance.
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8cab8bdc-e857-4ef2-98ec-ac51791e3d8a tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.618s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.policy [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a4f4aec1664e07b1d57a7848c02498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2983b563c19040dfbec3b2c10ce2d14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.184s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk 1073741824" returned: 0 in 0.074s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.180s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:35 user nova-compute[70375]: INFO nova.compute.claims [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Claim successful on node user
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Cannot resize image /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Ensure instance console log exists: /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Creating image(s)
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "/opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.policy [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edc5d742d0f4dc3ba67f1fad87937ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce4fa18b04c41078f64aa0af0777e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] No waiting events found dispatching network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:36 user nova-compute[70375]: WARNING nova.compute.manager [req-f55d3bb3-6cf2-4959-929d-6843f6cd92e2 req-85455b34-077d-4704-9f28-607104d31042 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received unexpected event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c for instance with vm_state active and task_state None.
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk 1073741824" returned: 0 in 0.072s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.239s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:47:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Cannot resize image /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'migration_context' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Ensure instance console log exists: /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Successfully updated port: 0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-changed-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Refreshing instance network info cache due to event network-changed-0e8525b5-b749-40ef-a718-06cb77902a2f. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] No waiting events found dispatching network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:38 user nova-compute[70375]: WARNING nova.compute.manager [req-54e41cb8-794c-4eb1-b2b1-25bbb8cea420 req-4d19faae-c06b-4dee-975b-d764aa5be7d9 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received unexpected event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c for instance with vm_state active and task_state None.
Jul 24 17:47:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Successfully created port: ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Successfully created port: 7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance network_info: |[{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Refreshing network info cache for port 0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start _get_guest_xml network_info=[{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:47:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1968919247',display_name='tempest-ServerRescueNegativeTestJSON-server-1968919247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1968919247',id=2,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-teimgbjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:32Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=be9aa713-99fd-4e4a-a5bb-50f30de8b7ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.objects.instance [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:47:39 user nova-compute[70375]:   <uuid>be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</uuid>
Jul 24 17:47:39 user nova-compute[70375]:   <name>instance-00000002</name>
Jul 24 17:47:39 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:47:39 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:47:39 user nova-compute[70375]:   <metadata>
Jul 24 17:47:39 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:47:39 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1968919247</nova:name>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:47:39</nova:creationTime>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:47:39 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:47:39 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:owner>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:47:39 user nova-compute[70375]:       </nova:owner>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:47:39 user nova-compute[70375]:       <nova:ports>
Jul 24 17:47:39 user nova-compute[70375]:         <nova:port uuid="0e8525b5-b749-40ef-a718-06cb77902a2f">
Jul 24 17:47:39 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:47:39 user nova-compute[70375]:         </nova:port>
Jul 24 17:47:39 user nova-compute[70375]:       </nova:ports>
Jul 24 17:47:39 user nova-compute[70375]:     </nova:instance>
Jul 24 17:47:39 user nova-compute[70375]:   </metadata>
Jul 24 17:47:39 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:47:39 user nova-compute[70375]:     <system>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="serial">be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</entry>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="uuid">be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</entry>
Jul 24 17:47:39 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:47:39 user nova-compute[70375]:     </system>
Jul 24 17:47:39 user nova-compute[70375]:   </sysinfo>
Jul 24 17:47:39 user nova-compute[70375]:   <os>
Jul 24 17:47:39 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:47:39 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:47:39 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:47:39 user nova-compute[70375]:   </os>
Jul 24 17:47:39 user nova-compute[70375]:   <features>
Jul 24 17:47:39 user nova-compute[70375]:     <acpi/>
Jul 24 17:47:39 user nova-compute[70375]:     <apic/>
Jul 24 17:47:39 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:47:39 user nova-compute[70375]:   </features>
Jul 24 17:47:39 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:47:39 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:47:39 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:47:39 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:47:39 user nova-compute[70375]:   </clock>
Jul 24 17:47:39 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:47:39 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:47:39 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:47:39 user nova-compute[70375]:   </cpu>
Jul 24 17:47:39 user nova-compute[70375]:   <devices>
Jul 24 17:47:39 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:47:39 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:47:39 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk"/>
Jul 24 17:47:39 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:47:39 user nova-compute[70375]:     </disk>
Jul 24 17:47:39 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:47:39 user nova-compute[70375]:       <mac address="fa:16:3e:6e:aa:fc"/>
Jul 24 17:47:39 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:39 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:47:39 user nova-compute[70375]:       <target dev="tap0e8525b5-b7"/>
Jul 24 17:47:39 user nova-compute[70375]:     </interface>
Jul 24 17:47:39 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:47:39 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/console.log" append="off"/>
Jul 24 17:47:39 user nova-compute[70375]:     </serial>
Jul 24 17:47:39 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:47:39 user nova-compute[70375]:     <video>
Jul 24 17:47:39 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:39 user nova-compute[70375]:     </video>
Jul 24 17:47:39 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:47:39 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:47:39 user nova-compute[70375]:     </rng>
Jul 24 17:47:39 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:47:39 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:47:39 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:47:39 user nova-compute[70375]:     </memballoon>
Jul 24 17:47:39 user nova-compute[70375]:   </devices>
Jul 24 17:47:39 user nova-compute[70375]: </domain>
Jul 24 17:47:39 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1968919247',display_name='tempest-ServerRescueNegativeTestJSON-server-1968919247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1968919247',id=2,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-teimgbjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:32Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=be9aa713-99fd-4e4a-a5bb-50f30de8b7ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG os_vif [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e8525b5-b7, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e8525b5-b7, col_values=(('external_ids', {'iface-id': '0e8525b5-b749-40ef-a718-06cb77902a2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:aa:fc', 'vm-uuid': 'be9aa713-99fd-4e4a-a5bb-50f30de8b7ae'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:39 user nova-compute[70375]: INFO os_vif [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7')
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:47:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:6e:aa:fc, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:40 user nova-compute[70375]: INFO nova.compute.claims [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Claim successful on node user
Jul 24 17:47:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Creating image(s)
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.187s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.network.neutron [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updated VIF entry in instance network info cache for port 0e8525b5-b749-40ef-a718-06cb77902a2f. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:47:41 user nova-compute[70375]: DEBUG nova.network.neutron [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a8f7f43-e51f-4825-aded-e27450884a36 req-618bf27d-9ead-4d0c-b155-46eced21eec1 service nova] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.policy [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49c33bc394214fa1a864e79cdef00465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79f1241a80f4fe498df5e46217254d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.194s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk 1073741824" returned: 0 in 0.082s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Successfully updated port: ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.170s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:42 user nova-compute[70375]: WARNING nova.compute.manager [req-c1ee32c8-6de9-4e6d-a667-9032958f5705 req-350af04c-3468-4724-ab70-209c53b0d7e2 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state building and task_state spawning.
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Cannot resize image /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'migration_context' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Ensure instance console log exists: /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-changed-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Refreshing instance network info cache due to event network-changed-ff87540f-1409-4b8e-a753-248a19b7836f. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance network_info: |[{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Refreshing network info cache for port ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start _get_guest_xml network_info=[{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:47:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1209451013',display_name='tempest-ServerRescueNegativeTestJSON-server-1209451013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1209451013',id=3,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-jk7mh80o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:35Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=f45c7f1d-bb87-42a6-a988-97d80a96225b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:47:43 user nova-compute[70375]:   <uuid>f45c7f1d-bb87-42a6-a988-97d80a96225b</uuid>
Jul 24 17:47:43 user nova-compute[70375]:   <name>instance-00000003</name>
Jul 24 17:47:43 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:47:43 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:47:43 user nova-compute[70375]:   <metadata>
Jul 24 17:47:43 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:47:43 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1209451013</nova:name>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:47:43</nova:creationTime>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:47:43 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:47:43 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:owner>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:47:43 user nova-compute[70375]:       </nova:owner>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:47:43 user nova-compute[70375]:       <nova:ports>
Jul 24 17:47:43 user nova-compute[70375]:         <nova:port uuid="ff87540f-1409-4b8e-a753-248a19b7836f">
Jul 24 17:47:43 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:47:43 user nova-compute[70375]:         </nova:port>
Jul 24 17:47:43 user nova-compute[70375]:       </nova:ports>
Jul 24 17:47:43 user nova-compute[70375]:     </nova:instance>
Jul 24 17:47:43 user nova-compute[70375]:   </metadata>
Jul 24 17:47:43 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:47:43 user nova-compute[70375]:     <system>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="serial">f45c7f1d-bb87-42a6-a988-97d80a96225b</entry>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="uuid">f45c7f1d-bb87-42a6-a988-97d80a96225b</entry>
Jul 24 17:47:43 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:47:43 user nova-compute[70375]:     </system>
Jul 24 17:47:43 user nova-compute[70375]:   </sysinfo>
Jul 24 17:47:43 user nova-compute[70375]:   <os>
Jul 24 17:47:43 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:47:43 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:47:43 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:47:43 user nova-compute[70375]:   </os>
Jul 24 17:47:43 user nova-compute[70375]:   <features>
Jul 24 17:47:43 user nova-compute[70375]:     <acpi/>
Jul 24 17:47:43 user nova-compute[70375]:     <apic/>
Jul 24 17:47:43 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:47:43 user nova-compute[70375]:   </features>
Jul 24 17:47:43 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:47:43 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:47:43 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:47:43 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:47:43 user nova-compute[70375]:   </clock>
Jul 24 17:47:43 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:47:43 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:47:43 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:47:43 user nova-compute[70375]:   </cpu>
Jul 24 17:47:43 user nova-compute[70375]:   <devices>
Jul 24 17:47:43 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:47:43 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:47:43 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk"/>
Jul 24 17:47:43 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:47:43 user nova-compute[70375]:     </disk>
Jul 24 17:47:43 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:47:43 user nova-compute[70375]:       <mac address="fa:16:3e:10:a3:54"/>
Jul 24 17:47:43 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:43 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:47:43 user nova-compute[70375]:       <target dev="tapff87540f-14"/>
Jul 24 17:47:43 user nova-compute[70375]:     </interface>
Jul 24 17:47:43 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:47:43 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/console.log" append="off"/>
Jul 24 17:47:43 user nova-compute[70375]:     </serial>
Jul 24 17:47:43 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:47:43 user nova-compute[70375]:     <video>
Jul 24 17:47:43 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:43 user nova-compute[70375]:     </video>
Jul 24 17:47:43 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:47:43 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:47:43 user nova-compute[70375]:     </rng>
Jul 24 17:47:43 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:47:43 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:47:43 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:47:43 user nova-compute[70375]:     </memballoon>
Jul 24 17:47:43 user nova-compute[70375]:   </devices>
Jul 24 17:47:43 user nova-compute[70375]: </domain>
Jul 24 17:47:43 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1209451013',display_name='tempest-ServerRescueNegativeTestJSON-server-1209451013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1209451013',id=3,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-jk7mh80o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:35Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=f45c7f1d-bb87-42a6-a988-97d80a96225b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG os_vif [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff87540f-14, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff87540f-14, col_values=(('external_ids', {'iface-id': 'ff87540f-1409-4b8e-a753-248a19b7836f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:a3:54', 'vm-uuid': 'f45c7f1d-bb87-42a6-a988-97d80a96225b'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:43 user nova-compute[70375]: INFO os_vif [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14')
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:10:a3:54, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220863.9308968, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:43 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Resumed (Lifecycle Event)
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance spawned successfully.
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:44 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220863.932568, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:44 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Started (Lifecycle Event)
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:44 user nova-compute[70375]: INFO nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Took 12.15 seconds to spawn the instance on the hypervisor.
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:44 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:44 user nova-compute[70375]: INFO nova.compute.manager [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Took 12.98 seconds to build instance.
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22f82e55-b2e9-44d2-9556-fb33f67e31d3 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.130s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Successfully updated port: 7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquired lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:44 user nova-compute[70375]: WARNING nova.compute.manager [req-f63782af-f8aa-4d12-a5d5-25434752a1e1 req-92c70d94-b8b5-44a9-9a3b-d193d39bf2b6 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state active and task_state None.
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-changed-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Refreshing instance network info cache due to event network-changed-7a90f720-81a5-4c3f-8127-09c271d8d51b. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] Acquiring lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updated VIF entry in instance network info cache for port ff87540f-1409-4b8e-a753-248a19b7836f. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b9548a74-a100-431a-8e6c-41661edb3964 req-75b2619c-e579-4eda-874a-cdc7fc0360ab service nova] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Successfully created port: 68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating instance_info_cache with network_info: [{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Releasing lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Instance network_info: |[{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] Acquired lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Refreshing network info cache for port 7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Start _get_guest_xml network_info=[{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:46 user nova-compute[70375]: WARNING nova.compute.manager [req-4cf3045b-04f7-415d-9b95-caab84f8d06c req-7cbac012-7528-499d-a386-2a89ed8ab2e9 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state building and task_state spawning.
Jul 24 17:47:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1134374557',display_name='tempest-AttachVolumeNegativeTest-server-1134374557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1134374557',id=4,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiKFaKYMvLVjldHiQbJqHjRFX2RR8J/AyftFdh0Ad9oSORy/uM1pMYbXWXOdlam42cBJGsIhk2b4xg61SiZo70LnCHcFJGHDhSgrCfiDMaxOAL1k6sI0qA8lhu0KtgZyA==',key_name='tempest-keypair-1840823664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-r85czy0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=a32f2c47-1d35-4436-9da4-7c94de7ed79c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'pci_devices' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:47:46 user nova-compute[70375]:   <uuid>a32f2c47-1d35-4436-9da4-7c94de7ed79c</uuid>
Jul 24 17:47:46 user nova-compute[70375]:   <name>instance-00000004</name>
Jul 24 17:47:46 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:47:46 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:47:46 user nova-compute[70375]:   <metadata>
Jul 24 17:47:46 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:47:46 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1134374557</nova:name>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:47:46</nova:creationTime>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:47:46 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:47:46 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:owner>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:user uuid="3edc5d742d0f4dc3ba67f1fad87937ac">tempest-AttachVolumeNegativeTest-777978815-project-member</nova:user>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:project uuid="7ce4fa18b04c41078f64aa0af0777e51">tempest-AttachVolumeNegativeTest-777978815</nova:project>
Jul 24 17:47:46 user nova-compute[70375]:       </nova:owner>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:47:46 user nova-compute[70375]:       <nova:ports>
Jul 24 17:47:46 user nova-compute[70375]:         <nova:port uuid="7a90f720-81a5-4c3f-8127-09c271d8d51b">
Jul 24 17:47:46 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 17:47:46 user nova-compute[70375]:         </nova:port>
Jul 24 17:47:46 user nova-compute[70375]:       </nova:ports>
Jul 24 17:47:46 user nova-compute[70375]:     </nova:instance>
Jul 24 17:47:46 user nova-compute[70375]:   </metadata>
Jul 24 17:47:46 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:47:46 user nova-compute[70375]:     <system>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="serial">a32f2c47-1d35-4436-9da4-7c94de7ed79c</entry>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="uuid">a32f2c47-1d35-4436-9da4-7c94de7ed79c</entry>
Jul 24 17:47:46 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:47:46 user nova-compute[70375]:     </system>
Jul 24 17:47:46 user nova-compute[70375]:   </sysinfo>
Jul 24 17:47:46 user nova-compute[70375]:   <os>
Jul 24 17:47:46 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:47:46 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:47:46 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:47:46 user nova-compute[70375]:   </os>
Jul 24 17:47:46 user nova-compute[70375]:   <features>
Jul 24 17:47:46 user nova-compute[70375]:     <acpi/>
Jul 24 17:47:46 user nova-compute[70375]:     <apic/>
Jul 24 17:47:46 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:47:46 user nova-compute[70375]:   </features>
Jul 24 17:47:46 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:47:46 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:47:46 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:47:46 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:47:46 user nova-compute[70375]:   </clock>
Jul 24 17:47:46 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:47:46 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:47:46 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:47:46 user nova-compute[70375]:   </cpu>
Jul 24 17:47:46 user nova-compute[70375]:   <devices>
Jul 24 17:47:46 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:47:46 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:47:46 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk"/>
Jul 24 17:47:46 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:47:46 user nova-compute[70375]:     </disk>
Jul 24 17:47:46 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:47:46 user nova-compute[70375]:       <mac address="fa:16:3e:f5:ad:80"/>
Jul 24 17:47:46 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:46 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:47:46 user nova-compute[70375]:       <target dev="tap7a90f720-81"/>
Jul 24 17:47:46 user nova-compute[70375]:     </interface>
Jul 24 17:47:46 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:47:46 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/console.log" append="off"/>
Jul 24 17:47:46 user nova-compute[70375]:     </serial>
Jul 24 17:47:46 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:47:46 user nova-compute[70375]:     <video>
Jul 24 17:47:46 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:46 user nova-compute[70375]:     </video>
Jul 24 17:47:46 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:47:46 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:47:46 user nova-compute[70375]:     </rng>
Jul 24 17:47:46 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:47:46 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:47:46 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:47:46 user nova-compute[70375]:     </memballoon>
Jul 24 17:47:46 user nova-compute[70375]:   </devices>
Jul 24 17:47:46 user nova-compute[70375]: </domain>
Jul 24 17:47:46 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1134374557',display_name='tempest-AttachVolumeNegativeTest-server-1134374557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1134374557',id=4,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiKFaKYMvLVjldHiQbJqHjRFX2RR8J/AyftFdh0Ad9oSORy/uM1pMYbXWXOdlam42cBJGsIhk2b4xg61SiZo70LnCHcFJGHDhSgrCfiDMaxOAL1k6sI0qA8lhu0KtgZyA==',key_name='tempest-keypair-1840823664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-r85czy0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=a32f2c47-1d35-4436-9da4-7c94de7ed79c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG os_vif [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a90f720-81, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a90f720-81, col_values=(('external_ids', {'iface-id': '7a90f720-81a5-4c3f-8127-09c271d8d51b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ad:80', 'vm-uuid': 'a32f2c47-1d35-4436-9da4-7c94de7ed79c'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:46 user nova-compute[70375]: INFO os_vif [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81')
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:47:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:f5:ad:80, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220867.5763986, f45c7f1d-bb87-42a6-a988-97d80a96225b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] VM Resumed (Lifecycle Event)
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance spawned successfully.
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220867.5854223, f45c7f1d-bb87-42a6-a988-97d80a96225b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] VM Started (Lifecycle Event)
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Took 13.04 seconds to spawn the instance on the hypervisor.
Jul 24 17:47:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:47 user nova-compute[70375]: INFO nova.compute.manager [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Took 14.32 seconds to build instance.
Jul 24 17:47:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-570eff6d-62e3-46c4-89d7-e060a3e4aaa4 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.489s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:48 user nova-compute[70375]: WARNING nova.compute.manager [req-de7b1b0f-8547-4d9f-8319-207b1bbf5f0b req-3c93eed9-e14c-407c-8450-501474bb5e5b service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state active and task_state None.
Jul 24 17:47:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updated VIF entry in instance network info cache for port 7a90f720-81a5-4c3f-8127-09c271d8d51b. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating instance_info_cache with network_info: [{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1aded28d-2960-4291-b812-90419da52f1e req-7264f523-8d6a-4601-83c6-f3a387b635d5 service nova] Releasing lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] No waiting events found dispatching network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:50 user nova-compute[70375]: WARNING nova.compute.manager [req-1ad25b72-4cea-4280-999f-7cd5fc1c0555 req-1da7a6a5-18e2-4b23-89fa-c47bd9be9c42 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received unexpected event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b for instance with vm_state building and task_state spawning.
Jul 24 17:47:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220871.2516499, a32f2c47-1d35-4436-9da4-7c94de7ed79c => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] VM Resumed (Lifecycle Event)
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Instance spawned successfully.
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220871.2529974, a32f2c47-1d35-4436-9da4-7c94de7ed79c => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] VM Started (Lifecycle Event)
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Took 15.32 seconds to spawn the instance on the hypervisor.
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:51 user nova-compute[70375]: INFO nova.compute.manager [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Took 16.22 seconds to build instance.
Jul 24 17:47:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f2d2afde-d865-47e6-9d9e-08df1804c455 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.423s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Successfully updated port: 68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:47:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-changed-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Refreshing instance network info cache due to event network-changed-68b0448f-d9ad-4486-9db5-9d9f1f626cae. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:47:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance network_info: |[{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Refreshing network info cache for port 68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start _get_guest_xml network_info=[{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:47:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'pci_devices' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:47:53 user nova-compute[70375]:   <uuid>81fd89d8-c2b9-4398-83f5-0ddb45f14722</uuid>
Jul 24 17:47:53 user nova-compute[70375]:   <name>instance-00000005</name>
Jul 24 17:47:53 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:47:53 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:47:53 user nova-compute[70375]:   <metadata>
Jul 24 17:47:53 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:47:53 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherB-server-358915896</nova:name>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:47:53</nova:creationTime>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:47:53 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:47:53 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:owner>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:user uuid="49c33bc394214fa1a864e79cdef00465">tempest-ServerActionsTestOtherB-1934690611-project-member</nova:user>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:project uuid="a79f1241a80f4fe498df5e46217254d1">tempest-ServerActionsTestOtherB-1934690611</nova:project>
Jul 24 17:47:53 user nova-compute[70375]:       </nova:owner>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:47:53 user nova-compute[70375]:       <nova:ports>
Jul 24 17:47:53 user nova-compute[70375]:         <nova:port uuid="68b0448f-d9ad-4486-9db5-9d9f1f626cae">
Jul 24 17:47:53 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:47:53 user nova-compute[70375]:         </nova:port>
Jul 24 17:47:53 user nova-compute[70375]:       </nova:ports>
Jul 24 17:47:53 user nova-compute[70375]:     </nova:instance>
Jul 24 17:47:53 user nova-compute[70375]:   </metadata>
Jul 24 17:47:53 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:47:53 user nova-compute[70375]:     <system>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="serial">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="uuid">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:47:53 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:47:53 user nova-compute[70375]:     </system>
Jul 24 17:47:53 user nova-compute[70375]:   </sysinfo>
Jul 24 17:47:53 user nova-compute[70375]:   <os>
Jul 24 17:47:53 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:47:53 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:47:53 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:47:53 user nova-compute[70375]:   </os>
Jul 24 17:47:53 user nova-compute[70375]:   <features>
Jul 24 17:47:53 user nova-compute[70375]:     <acpi/>
Jul 24 17:47:53 user nova-compute[70375]:     <apic/>
Jul 24 17:47:53 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:47:53 user nova-compute[70375]:   </features>
Jul 24 17:47:53 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:47:53 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:47:53 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:47:53 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:47:53 user nova-compute[70375]:   </clock>
Jul 24 17:47:53 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:47:53 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:47:53 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:47:53 user nova-compute[70375]:   </cpu>
Jul 24 17:47:53 user nova-compute[70375]:   <devices>
Jul 24 17:47:53 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:47:53 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:47:53 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk"/>
Jul 24 17:47:53 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:47:53 user nova-compute[70375]:     </disk>
Jul 24 17:47:53 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:47:53 user nova-compute[70375]:       <mac address="fa:16:3e:4d:88:af"/>
Jul 24 17:47:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:53 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:47:53 user nova-compute[70375]:       <target dev="tap68b0448f-d9"/>
Jul 24 17:47:53 user nova-compute[70375]:     </interface>
Jul 24 17:47:53 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:47:53 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/console.log" append="off"/>
Jul 24 17:47:53 user nova-compute[70375]:     </serial>
Jul 24 17:47:53 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:47:53 user nova-compute[70375]:     <video>
Jul 24 17:47:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:47:53 user nova-compute[70375]:     </video>
Jul 24 17:47:53 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:47:53 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:47:53 user nova-compute[70375]:     </rng>
Jul 24 17:47:53 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:47:53 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:47:53 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:47:53 user nova-compute[70375]:     </memballoon>
Jul 24 17:47:53 user nova-compute[70375]:   </devices>
Jul 24 17:47:53 user nova-compute[70375]: </domain>
Jul 24 17:47:53 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG os_vif [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b0448f-d9, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b0448f-d9, col_values=(('external_ids', {'iface-id': '68b0448f-d9ad-4486-9db5-9d9f1f626cae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:88:af', 'vm-uuid': '81fd89d8-c2b9-4398-83f5-0ddb45f14722'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:53 user nova-compute[70375]: INFO os_vif [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:47:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No VIF found with MAC fa:16:3e:4d:88:af, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:47:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:55 user nova-compute[70375]: WARNING nova.compute.manager [req-d0d83ae4-3c21-413c-b7a3-97ec00ec30fb req-92dfeb4b-c546-4800-b790-e28af0302697 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state building and task_state spawning.
Jul 24 17:47:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updated VIF entry in instance network info cache for port 68b0448f-d9ad-4486-9db5-9d9f1f626cae. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] No waiting events found dispatching network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:56 user nova-compute[70375]: WARNING nova.compute.manager [req-ebdca10c-c005-483e-ad4f-c3e496caf5f6 req-7434ea60-39e9-44c6-84c3-ed41c910da36 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received unexpected event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b for instance with vm_state active and task_state None.
Jul 24 17:47:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:47:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:47:57 user nova-compute[70375]: WARNING nova.compute.manager [req-8b06de7c-10f6-4601-b0f3-8699945396d5 req-540a911c-a8a5-49c8-8673-9b3245b7f010 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state building and task_state spawning.
Jul 24 17:47:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220878.277205, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Resumed (Lifecycle Event)
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance spawned successfully.
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220878.284963, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Started (Lifecycle Event)
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.claims [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Claim successful on node user
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Took 16.98 seconds to spawn the instance on the hypervisor.
Jul 24 17:47:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:47:58 user nova-compute[70375]: INFO nova.compute.manager [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Took 18.10 seconds to build instance.
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7c610286-2c52-4a65-aed1-bbe9824f3bef tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.230s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.970s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:47:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.policy [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86f2a560b934073bad9013cd14e52bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b872f286b614678a434d45336ab0d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:47:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Creating image(s)
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "/opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "/opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "/opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:47:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.237s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.170s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk 1073741824" returned: 0 in 0.070s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Cannot resize image /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lazy-loading 'migration_context' on Instance uuid 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Ensure instance console log exists: /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Successfully created port: 310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:03 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:48:03 user nova-compute[70375]: INFO nova.compute.claims [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Claim successful on node user
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Successfully updated port: 310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquired lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-changed-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Refreshing instance network info cache due to event network-changed-310c0730-9b68-4fb1-8684-5f97b4b98a02. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] Acquiring lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:48:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:48:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Creating image(s)
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "/opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "/opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "/opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG nova.policy [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '489f6bd0397e442f8967b992adc9a998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd425958d88754a4f8c9a31bbd7d9715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.194s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Updating instance_info_cache with network_info: [{"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Releasing lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Instance network_info: |[{"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] Acquired lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.neutron [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Refreshing network info cache for port 310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Start _get_guest_xml network_info=[{"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.217s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:05 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:05 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk 1073741824" returned: 0 in 0.104s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-823491577',display_name='tempest-VolumesActionsTest-instance-823491577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-823491577',id=6,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b872f286b614678a434d45336ab0d42',ramdisk_id='',reservation_id='r-lm7yy0hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-160017716',owner_user_name='tempest-VolumesActionsTest-160017716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:00Z,user_data=None,user_id='f86f2a560b934073bad9013cd14e52bc',uuid=26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converting VIF {"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lazy-loading 'pci_devices' on Instance uuid 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:48:05 user nova-compute[70375]:   <uuid>26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b</uuid>
Jul 24 17:48:05 user nova-compute[70375]:   <name>instance-00000006</name>
Jul 24 17:48:05 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:48:05 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:48:05 user nova-compute[70375]:   <metadata>
Jul 24 17:48:05 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:48:05 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:name>tempest-VolumesActionsTest-instance-823491577</nova:name>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:48:05</nova:creationTime>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:48:05 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:48:05 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:owner>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:user uuid="f86f2a560b934073bad9013cd14e52bc">tempest-VolumesActionsTest-160017716-project-member</nova:user>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:project uuid="9b872f286b614678a434d45336ab0d42">tempest-VolumesActionsTest-160017716</nova:project>
Jul 24 17:48:05 user nova-compute[70375]:       </nova:owner>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:48:05 user nova-compute[70375]:       <nova:ports>
Jul 24 17:48:05 user nova-compute[70375]:         <nova:port uuid="310c0730-9b68-4fb1-8684-5f97b4b98a02">
Jul 24 17:48:05 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:48:05 user nova-compute[70375]:         </nova:port>
Jul 24 17:48:05 user nova-compute[70375]:       </nova:ports>
Jul 24 17:48:05 user nova-compute[70375]:     </nova:instance>
Jul 24 17:48:05 user nova-compute[70375]:   </metadata>
Jul 24 17:48:05 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:48:05 user nova-compute[70375]:     <system>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="serial">26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b</entry>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="uuid">26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b</entry>
Jul 24 17:48:05 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:48:05 user nova-compute[70375]:     </system>
Jul 24 17:48:05 user nova-compute[70375]:   </sysinfo>
Jul 24 17:48:05 user nova-compute[70375]:   <os>
Jul 24 17:48:05 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:48:05 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:48:05 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:48:05 user nova-compute[70375]:   </os>
Jul 24 17:48:05 user nova-compute[70375]:   <features>
Jul 24 17:48:05 user nova-compute[70375]:     <acpi/>
Jul 24 17:48:05 user nova-compute[70375]:     <apic/>
Jul 24 17:48:05 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:48:05 user nova-compute[70375]:   </features>
Jul 24 17:48:05 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:48:05 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:48:05 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:48:05 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:48:05 user nova-compute[70375]:   </clock>
Jul 24 17:48:05 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:48:05 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:48:05 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:48:05 user nova-compute[70375]:   </cpu>
Jul 24 17:48:05 user nova-compute[70375]:   <devices>
Jul 24 17:48:05 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:48:05 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:48:05 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk"/>
Jul 24 17:48:05 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:48:05 user nova-compute[70375]:     </disk>
Jul 24 17:48:05 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:48:05 user nova-compute[70375]:       <mac address="fa:16:3e:a8:2e:da"/>
Jul 24 17:48:05 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:05 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:48:05 user nova-compute[70375]:       <target dev="tap310c0730-9b"/>
Jul 24 17:48:05 user nova-compute[70375]:     </interface>
Jul 24 17:48:05 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:48:05 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/console.log" append="off"/>
Jul 24 17:48:05 user nova-compute[70375]:     </serial>
Jul 24 17:48:05 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:48:05 user nova-compute[70375]:     <video>
Jul 24 17:48:05 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:05 user nova-compute[70375]:     </video>
Jul 24 17:48:05 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:48:05 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:48:05 user nova-compute[70375]:     </rng>
Jul 24 17:48:05 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:48:05 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:48:05 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:48:05 user nova-compute[70375]:     </memballoon>
Jul 24 17:48:05 user nova-compute[70375]:   </devices>
Jul 24 17:48:05 user nova-compute[70375]: </domain>
Jul 24 17:48:05 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-823491577',display_name='tempest-VolumesActionsTest-instance-823491577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-823491577',id=6,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b872f286b614678a434d45336ab0d42',ramdisk_id='',reservation_id='r-lm7yy0hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-160017716',owner_user_name='tempest-VolumesActionsTest-160017716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:00Z,user_data=None,user_id='f86f2a560b934073bad9013cd14e52bc',uuid=26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converting VIF {"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG os_vif [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.215s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap310c0730-9b, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap310c0730-9b, col_values=(('external_ids', {'iface-id': '310c0730-9b68-4fb1-8684-5f97b4b98a02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:2e:da', 'vm-uuid': '26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:48:05 user nova-compute[70375]: INFO os_vif [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b')
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] No VIF found with MAC fa:16:3e:a8:2e:da, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Cannot resize image /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'migration_context' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Ensure instance console log exists: /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:48:07 user nova-compute[70375]: INFO nova.compute.claims [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Claim successful on node user
Jul 24 17:48:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Updated VIF entry in instance network info cache for port 310c0730-9b68-4fb1-8684-5f97b4b98a02. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Updating instance_info_cache with network_info: [{"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07b8e676-4e2a-4c45-9265-cf785e912b0c req-d03e12da-d16c-4b86-a11f-bdf98033f665 service nova] Releasing lock "refresh_cache-26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Successfully created port: 8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] No waiting events found dispatching network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:08 user nova-compute[70375]: WARNING nova.compute.manager [req-2068c576-33dc-4e41-ad4f-4b56e404900e req-844622c4-3055-449d-944a-99b47ed9b99d service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received unexpected event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 for instance with vm_state building and task_state spawning.
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.271s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:48:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:48:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Creating image(s)
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "/opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "/opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk 1073741824" returned: 0 in 0.058s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.policy [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73c2d89b17c4483a8ad361f66d614ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1466ce4246a54ebaa29ee3e99f20eb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.204s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:09 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Successfully updated port: 8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquired lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] No waiting events found dispatching network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:10 user nova-compute[70375]: WARNING nova.compute.manager [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received unexpected event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 for instance with vm_state building and task_state spawning.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-changed-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Refreshing instance network info cache due to event network-changed-8b4a1f26-60a5-4e34-8427-bff51e93a458. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Acquiring lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220890.5344915, 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] VM Resumed (Lifecycle Event)
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Instance spawned successfully.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating instance_info_cache with network_info: [{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220890.5354142, 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] VM Started (Lifecycle Event)
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Releasing lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Instance network_info: |[{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Acquired lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.neutron [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Refreshing network info cache for port 8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Start _get_guest_xml network_info=[{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Successfully created port: 986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Took 10.83 seconds to spawn the instance on the hypervisor.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968178223',display_name='tempest-VolumesAdminNegativeTest-server-968178223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968178223',id=7,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfz4SIJaM12nqqyBRHM/D3k/GHYYe+ghvWWATtKfQRfTNox02pkhhjDto9OB25B91LeNkNsLZVTKDxLyy9yj21OgDQkH98SoxZpfURsQVLGv3OfwlxtroYmk7hZBfYjJA==',key_name='tempest-keypair-398251727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-o1yauowy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489f6bd0397e442f8967b992adc9a998',uuid=06592a39-04a0-4e73-bb76-546a29fedab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'pci_devices' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:48:10 user nova-compute[70375]:   <uuid>06592a39-04a0-4e73-bb76-546a29fedab3</uuid>
Jul 24 17:48:10 user nova-compute[70375]:   <name>instance-00000007</name>
Jul 24 17:48:10 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:48:10 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:48:10 user nova-compute[70375]:   <metadata>
Jul 24 17:48:10 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:48:10 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:name>tempest-VolumesAdminNegativeTest-server-968178223</nova:name>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:48:10</nova:creationTime>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:48:10 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:48:10 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:owner>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:user uuid="489f6bd0397e442f8967b992adc9a998">tempest-VolumesAdminNegativeTest-2106539128-project-member</nova:user>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:project uuid="d425958d88754a4f8c9a31bbd7d9715c">tempest-VolumesAdminNegativeTest-2106539128</nova:project>
Jul 24 17:48:10 user nova-compute[70375]:       </nova:owner>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:48:10 user nova-compute[70375]:       <nova:ports>
Jul 24 17:48:10 user nova-compute[70375]:         <nova:port uuid="8b4a1f26-60a5-4e34-8427-bff51e93a458">
Jul 24 17:48:10 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:48:10 user nova-compute[70375]:         </nova:port>
Jul 24 17:48:10 user nova-compute[70375]:       </nova:ports>
Jul 24 17:48:10 user nova-compute[70375]:     </nova:instance>
Jul 24 17:48:10 user nova-compute[70375]:   </metadata>
Jul 24 17:48:10 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:48:10 user nova-compute[70375]:     <system>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="serial">06592a39-04a0-4e73-bb76-546a29fedab3</entry>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="uuid">06592a39-04a0-4e73-bb76-546a29fedab3</entry>
Jul 24 17:48:10 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:48:10 user nova-compute[70375]:     </system>
Jul 24 17:48:10 user nova-compute[70375]:   </sysinfo>
Jul 24 17:48:10 user nova-compute[70375]:   <os>
Jul 24 17:48:10 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:48:10 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:48:10 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:48:10 user nova-compute[70375]:   </os>
Jul 24 17:48:10 user nova-compute[70375]:   <features>
Jul 24 17:48:10 user nova-compute[70375]:     <acpi/>
Jul 24 17:48:10 user nova-compute[70375]:     <apic/>
Jul 24 17:48:10 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:48:10 user nova-compute[70375]:   </features>
Jul 24 17:48:10 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:48:10 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:48:10 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:48:10 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:48:10 user nova-compute[70375]:   </clock>
Jul 24 17:48:10 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:48:10 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:48:10 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:48:10 user nova-compute[70375]:   </cpu>
Jul 24 17:48:10 user nova-compute[70375]:   <devices>
Jul 24 17:48:10 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:48:10 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:48:10 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk"/>
Jul 24 17:48:10 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:48:10 user nova-compute[70375]:     </disk>
Jul 24 17:48:10 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:48:10 user nova-compute[70375]:       <mac address="fa:16:3e:08:f8:2f"/>
Jul 24 17:48:10 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:10 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:48:10 user nova-compute[70375]:       <target dev="tap8b4a1f26-60"/>
Jul 24 17:48:10 user nova-compute[70375]:     </interface>
Jul 24 17:48:10 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:48:10 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/console.log" append="off"/>
Jul 24 17:48:10 user nova-compute[70375]:     </serial>
Jul 24 17:48:10 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:48:10 user nova-compute[70375]:     <video>
Jul 24 17:48:10 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:10 user nova-compute[70375]:     </video>
Jul 24 17:48:10 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:48:10 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:48:10 user nova-compute[70375]:     </rng>
Jul 24 17:48:10 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:48:10 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:48:10 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:48:10 user nova-compute[70375]:     </memballoon>
Jul 24 17:48:10 user nova-compute[70375]:   </devices>
Jul 24 17:48:10 user nova-compute[70375]: </domain>
Jul 24 17:48:10 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968178223',display_name='tempest-VolumesAdminNegativeTest-server-968178223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968178223',id=7,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfz4SIJaM12nqqyBRHM/D3k/GHYYe+ghvWWATtKfQRfTNox02pkhhjDto9OB25B91LeNkNsLZVTKDxLyy9yj21OgDQkH98SoxZpfURsQVLGv3OfwlxtroYmk7hZBfYjJA==',key_name='tempest-keypair-398251727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-o1yauowy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489f6bd0397e442f8967b992adc9a998',uuid=06592a39-04a0-4e73-bb76-546a29fedab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG os_vif [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4a1f26-60, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b4a1f26-60, col_values=(('external_ids', {'iface-id': '8b4a1f26-60a5-4e34-8427-bff51e93a458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:f8:2f', 'vm-uuid': '06592a39-04a0-4e73-bb76-546a29fedab3'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:10 user nova-compute[70375]: INFO nova.compute.manager [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Took 12.53 seconds to build instance.
Jul 24 17:48:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:10 user nova-compute[70375]: INFO os_vif [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60')
Jul 24 17:48:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53a9cfc0-10ae-4a36-b5d3-80930ad53772 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.810s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No VIF found with MAC fa:16:3e:08:f8:2f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:48:11 user nova-compute[70375]: INFO nova.compute.claims [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Claim successful on node user
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:48:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updated VIF entry in instance network info cache for port 8b4a1f26-60a5-4e34-8427-bff51e93a458. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating instance_info_cache with network_info: [{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ea572c8-c8a5-4409-beb3-41ef2a1a2b61 req-064aecaf-54a7-4eb9-b14f-5c77081447b6 service nova] Releasing lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:48:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Creating image(s)
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "e1c4ce8239511d4f71c5653522960442037f2214" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "e1c4ce8239511d4f71c5653522960442037f2214" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Successfully updated port: 986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.policy [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d183dba1af14851b3a6b56cc3ed42c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4afdbf439e34a50b8f4f4e150c53135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] No waiting events found dispatching network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:13 user nova-compute[70375]: WARNING nova.compute.manager [req-29e4a748-36d3-4c90-ab0c-802205f37b20 req-1cf9ea2c-d95e-4fa3-af14-8ac8e185c48c service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received unexpected event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 for instance with vm_state building and task_state spawning.
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquired lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-changed-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Refreshing instance network info cache due to event network-changed-986e75bf-5600-44d7-9629-6b543ad130fc. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] Acquiring lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.part --force-share --output=json" returned: 0 in 0.196s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.virt.images [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] 55661654-b7ea-4b91-8ee6-d1aded0d1195 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.part /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.part /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.converted" returned: 0 in 0.324s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "e1c4ce8239511d4f71c5653522960442037f2214" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.405s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json" returned: 0 in 0.192s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "e1c4ce8239511d4f71c5653522960442037f2214" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "e1c4ce8239511d4f71c5653522960442037f2214" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updating instance_info_cache with network_info: [{"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Releasing lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Instance network_info: |[{"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] Acquired lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.neutron [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Refreshing network info cache for port 986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Start _get_guest_xml network_info=[{"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:48:14 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:14 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-312430646',display_name='tempest-TestVolumeSwap-server-312430646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-312430646',id=8,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2DXKkaT4mFOCtkzDpKhloVu8rHW5CUlHpVQLzR2TPUNlxpNL+gBOdvutgeXAjtEtUz5VjpR3j74UlGZdK7SiVCkfttE7+HxK/sFBzfwAYjmCsD3YP1WAXgt19Tkd4RMA==',key_name='tempest-keypair-192527649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466ce4246a54ebaa29ee3e99f20eb6b',ramdisk_id='',reservation_id='r-v34bjtmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1558601436',owner_user_name='tempest-TestVolumeSwap-1558601436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c2d89b17c4483a8ad361f66d614ef0',uuid=5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converting VIF {"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json" returned: 0 in 0.275s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214,backing_fmt=raw /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:48:14 user nova-compute[70375]:   <uuid>5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4</uuid>
Jul 24 17:48:14 user nova-compute[70375]:   <name>instance-00000008</name>
Jul 24 17:48:14 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:48:14 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:48:14 user nova-compute[70375]:   <metadata>
Jul 24 17:48:14 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:48:14 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:name>tempest-TestVolumeSwap-server-312430646</nova:name>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:48:14</nova:creationTime>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:48:14 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:48:14 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:owner>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:user uuid="73c2d89b17c4483a8ad361f66d614ef0">tempest-TestVolumeSwap-1558601436-project-member</nova:user>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:project uuid="1466ce4246a54ebaa29ee3e99f20eb6b">tempest-TestVolumeSwap-1558601436</nova:project>
Jul 24 17:48:14 user nova-compute[70375]:       </nova:owner>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:48:14 user nova-compute[70375]:       <nova:ports>
Jul 24 17:48:14 user nova-compute[70375]:         <nova:port uuid="986e75bf-5600-44d7-9629-6b543ad130fc">
Jul 24 17:48:14 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 17:48:14 user nova-compute[70375]:         </nova:port>
Jul 24 17:48:14 user nova-compute[70375]:       </nova:ports>
Jul 24 17:48:14 user nova-compute[70375]:     </nova:instance>
Jul 24 17:48:14 user nova-compute[70375]:   </metadata>
Jul 24 17:48:14 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:48:14 user nova-compute[70375]:     <system>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="serial">5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4</entry>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="uuid">5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4</entry>
Jul 24 17:48:14 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:48:14 user nova-compute[70375]:     </system>
Jul 24 17:48:14 user nova-compute[70375]:   </sysinfo>
Jul 24 17:48:14 user nova-compute[70375]:   <os>
Jul 24 17:48:14 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:48:14 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:48:14 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:48:14 user nova-compute[70375]:   </os>
Jul 24 17:48:14 user nova-compute[70375]:   <features>
Jul 24 17:48:14 user nova-compute[70375]:     <acpi/>
Jul 24 17:48:14 user nova-compute[70375]:     <apic/>
Jul 24 17:48:14 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:48:14 user nova-compute[70375]:   </features>
Jul 24 17:48:14 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:48:14 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:48:14 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:48:14 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:48:14 user nova-compute[70375]:   </clock>
Jul 24 17:48:14 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:48:14 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:48:14 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:48:14 user nova-compute[70375]:   </cpu>
Jul 24 17:48:14 user nova-compute[70375]:   <devices>
Jul 24 17:48:14 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:48:14 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:48:14 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk"/>
Jul 24 17:48:14 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:48:14 user nova-compute[70375]:     </disk>
Jul 24 17:48:14 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:48:14 user nova-compute[70375]:       <mac address="fa:16:3e:97:c5:b8"/>
Jul 24 17:48:14 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:14 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:48:14 user nova-compute[70375]:       <target dev="tap986e75bf-56"/>
Jul 24 17:48:14 user nova-compute[70375]:     </interface>
Jul 24 17:48:14 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:48:14 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/console.log" append="off"/>
Jul 24 17:48:14 user nova-compute[70375]:     </serial>
Jul 24 17:48:14 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:48:14 user nova-compute[70375]:     <video>
Jul 24 17:48:14 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:14 user nova-compute[70375]:     </video>
Jul 24 17:48:14 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:48:14 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:48:14 user nova-compute[70375]:     </rng>
Jul 24 17:48:14 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:48:14 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:48:14 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:48:14 user nova-compute[70375]:     </memballoon>
Jul 24 17:48:14 user nova-compute[70375]:   </devices>
Jul 24 17:48:14 user nova-compute[70375]: </domain>
Jul 24 17:48:14 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-312430646',display_name='tempest-TestVolumeSwap-server-312430646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-312430646',id=8,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2DXKkaT4mFOCtkzDpKhloVu8rHW5CUlHpVQLzR2TPUNlxpNL+gBOdvutgeXAjtEtUz5VjpR3j74UlGZdK7SiVCkfttE7+HxK/sFBzfwAYjmCsD3YP1WAXgt19Tkd4RMA==',key_name='tempest-keypair-192527649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466ce4246a54ebaa29ee3e99f20eb6b',ramdisk_id='',reservation_id='r-v34bjtmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1558601436',owner_user_name='tempest-TestVolumeSwap-1558601436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c2d89b17c4483a8ad361f66d614ef0',uuid=5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converting VIF {"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG os_vif [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Successfully created port: 1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214,backing_fmt=raw /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk 1073741824" returned: 0 in 0.096s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "e1c4ce8239511d4f71c5653522960442037f2214" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap986e75bf-56, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap986e75bf-56, col_values=(('external_ids', {'iface-id': '986e75bf-5600-44d7-9629-6b543ad130fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c5:b8', 'vm-uuid': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:48:14 user nova-compute[70375]: INFO os_vif [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56')
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] No VIF found with MAC fa:16:3e:97:c5:b8, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 --force-share --output=json" returned: 0 in 0.188s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Cannot resize image /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.objects.instance [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'migration_context' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Ensure instance console log exists: /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updated VIF entry in instance network info cache for port 986e75bf-5600-44d7-9629-6b543ad130fc. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updating instance_info_cache with network_info: [{"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9ff65dd8-297c-4265-8950-9ae748b012fd req-9e349178-1178-4114-a1eb-0dd0e4e6c45e service nova] Releasing lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] No waiting events found dispatching network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:15 user nova-compute[70375]: WARNING nova.compute.manager [req-1cc1e348-e0d2-4795-8361-d32224d2a73e req-9ee2e0c6-ee2a-4c68-9c16-323a32b3765d service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received unexpected event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 for instance with vm_state building and task_state spawning.
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220895.4939992, 06592a39-04a0-4e73-bb76-546a29fedab3 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] VM Resumed (Lifecycle Event)
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Instance spawned successfully.
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220895.5141616, 06592a39-04a0-4e73-bb76-546a29fedab3 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] VM Started (Lifecycle Event)
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Took 10.94 seconds to spawn the instance on the hypervisor.
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Successfully updated port: 1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquired lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:48:15 user nova-compute[70375]: INFO nova.compute.manager [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Took 12.27 seconds to build instance.
Jul 24 17:48:15 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cb94dc27-476f-40fd-b723-a79e036e04a8 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.422s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updating instance_info_cache with network_info: [{"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Releasing lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Instance network_info: |[{"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Start _get_guest_xml network_info=[{"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:48:02Z,direct_url=<?>,disk_format='qcow2',id=55661654-b7ea-4b91-8ee6-d1aded0d1195,min_disk=0,min_ram=0,name='',owner='ef1aeb21b6e448abada569d8efa0dcdb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:48:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'boot_index': 0, 'disk_bus': 'scsi', 'size': 0, 'image_id': '55661654-b7ea-4b91-8ee6-d1aded0d1195'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:48:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:48:02Z,direct_url=<?>,disk_format='qcow2',id=55661654-b7ea-4b91-8ee6-d1aded0d1195,min_disk=0,min_ram=0,name='',owner='ef1aeb21b6e448abada569d8efa0dcdb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:48:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-846125168',display_name='tempest-AttachSCSIVolumeTestJSON-server-846125168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-846125168',id=9,image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwcXYsB7TE6W+EukYrqvRTiSN/LSavI0nw965W/w59Wnt/hnzV0W/ARfXtGaNy3bgFX5EClANX3eHT2W9l+lQ1TDUpZ3NbLPwFNms8PCNbJUDhl/8+5+h80gGaL8bFtwQ==',key_name='tempest-keypair-329978910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4afdbf439e34a50b8f4f4e150c53135',ramdisk_id='',reservation_id='r-jfi1n9y4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1154458008',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1154458008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d183dba1af14851b3a6b56cc3ed42c2',uuid=baeaab3c-ddf0-408f-b148-1afc070a32f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converting VIF {"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'pci_devices' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:48:16 user nova-compute[70375]:   <uuid>baeaab3c-ddf0-408f-b148-1afc070a32f6</uuid>
Jul 24 17:48:16 user nova-compute[70375]:   <name>instance-00000009</name>
Jul 24 17:48:16 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:48:16 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:48:16 user nova-compute[70375]:   <metadata>
Jul 24 17:48:16 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:48:16 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-846125168</nova:name>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:48:16</nova:creationTime>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:48:16 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:48:16 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:owner>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:user uuid="7d183dba1af14851b3a6b56cc3ed42c2">tempest-AttachSCSIVolumeTestJSON-1154458008-project-member</nova:user>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:project uuid="b4afdbf439e34a50b8f4f4e150c53135">tempest-AttachSCSIVolumeTestJSON-1154458008</nova:project>
Jul 24 17:48:16 user nova-compute[70375]:       </nova:owner>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:root type="image" uuid="55661654-b7ea-4b91-8ee6-d1aded0d1195"/>
Jul 24 17:48:16 user nova-compute[70375]:       <nova:ports>
Jul 24 17:48:16 user nova-compute[70375]:         <nova:port uuid="1643285b-2fcb-4065-b5e8-9aa786078d29">
Jul 24 17:48:16 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 17:48:16 user nova-compute[70375]:         </nova:port>
Jul 24 17:48:16 user nova-compute[70375]:       </nova:ports>
Jul 24 17:48:16 user nova-compute[70375]:     </nova:instance>
Jul 24 17:48:16 user nova-compute[70375]:   </metadata>
Jul 24 17:48:16 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:48:16 user nova-compute[70375]:     <system>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="serial">baeaab3c-ddf0-408f-b148-1afc070a32f6</entry>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="uuid">baeaab3c-ddf0-408f-b148-1afc070a32f6</entry>
Jul 24 17:48:16 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:48:16 user nova-compute[70375]:     </system>
Jul 24 17:48:16 user nova-compute[70375]:   </sysinfo>
Jul 24 17:48:16 user nova-compute[70375]:   <os>
Jul 24 17:48:16 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:48:16 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:48:16 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:48:16 user nova-compute[70375]:   </os>
Jul 24 17:48:16 user nova-compute[70375]:   <features>
Jul 24 17:48:16 user nova-compute[70375]:     <acpi/>
Jul 24 17:48:16 user nova-compute[70375]:     <apic/>
Jul 24 17:48:16 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:48:16 user nova-compute[70375]:   </features>
Jul 24 17:48:16 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:48:16 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:48:16 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:48:16 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:48:16 user nova-compute[70375]:   </clock>
Jul 24 17:48:16 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:48:16 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:48:16 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:48:16 user nova-compute[70375]:   </cpu>
Jul 24 17:48:16 user nova-compute[70375]:   <devices>
Jul 24 17:48:16 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:48:16 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:48:16 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk"/>
Jul 24 17:48:16 user nova-compute[70375]:       <target dev="sda" bus="scsi"/>
Jul 24 17:48:16 user nova-compute[70375]:       <address type="drive" controller="0" unit="0"/>
Jul 24 17:48:16 user nova-compute[70375]:     </disk>
Jul 24 17:48:16 user nova-compute[70375]:     <disk type="file" device="cdrom">
Jul 24 17:48:16 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 17:48:16 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.config"/>
Jul 24 17:48:16 user nova-compute[70375]:       <target dev="sdb" bus="scsi"/>
Jul 24 17:48:16 user nova-compute[70375]:       <address type="drive" controller="0" unit="1"/>
Jul 24 17:48:16 user nova-compute[70375]:     </disk>
Jul 24 17:48:16 user nova-compute[70375]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 24 17:48:16 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:48:16 user nova-compute[70375]:       <mac address="fa:16:3e:c9:3c:7f"/>
Jul 24 17:48:16 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:16 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:48:16 user nova-compute[70375]:       <target dev="tap1643285b-2f"/>
Jul 24 17:48:16 user nova-compute[70375]:     </interface>
Jul 24 17:48:16 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:48:16 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/console.log" append="off"/>
Jul 24 17:48:16 user nova-compute[70375]:     </serial>
Jul 24 17:48:16 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:48:16 user nova-compute[70375]:     <video>
Jul 24 17:48:16 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:48:16 user nova-compute[70375]:     </video>
Jul 24 17:48:16 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:48:16 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:48:16 user nova-compute[70375]:     </rng>
Jul 24 17:48:16 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:48:16 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:48:16 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:48:16 user nova-compute[70375]:     </memballoon>
Jul 24 17:48:16 user nova-compute[70375]:   </devices>
Jul 24 17:48:16 user nova-compute[70375]: </domain>
Jul 24 17:48:16 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-846125168',display_name='tempest-AttachSCSIVolumeTestJSON-server-846125168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-846125168',id=9,image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwcXYsB7TE6W+EukYrqvRTiSN/LSavI0nw965W/w59Wnt/hnzV0W/ARfXtGaNy3bgFX5EClANX3eHT2W9l+lQ1TDUpZ3NbLPwFNms8PCNbJUDhl/8+5+h80gGaL8bFtwQ==',key_name='tempest-keypair-329978910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4afdbf439e34a50b8f4f4e150c53135',ramdisk_id='',reservation_id='r-jfi1n9y4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1154458008',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1154458008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d183dba1af14851b3a6b56cc3ed42c2',uuid=baeaab3c-ddf0-408f-b148-1afc070a32f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converting VIF {"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG os_vif [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Skipping network cache update for instance because it is Building. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Skipping network cache update for instance because it is Building. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1643285b-2f, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1643285b-2f, col_values=(('external_ids', {'iface-id': '1643285b-2fcb-4065-b5e8-9aa786078d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:3c:7f', 'vm-uuid': 'baeaab3c-ddf0-408f-b148-1afc070a32f6'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:16 user nova-compute[70375]: INFO os_vif [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f')
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No BDM found with device name sda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No VIF found with MAC fa:16:3e:c9:3c:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:48:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Using config drive
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] No waiting events found dispatching network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:16 user nova-compute[70375]: WARNING nova.compute.manager [req-3aeadfbd-54ed-4b93-85a6-faff4b262470 req-e18c8ecc-5c33-4fba-9265-060a9699c839 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received unexpected event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc for instance with vm_state building and task_state spawning.
Jul 24 17:48:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Creating config drive at /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.config
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgp2mi4ov {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgp2mi4ov" returned: 0 in 0.080s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updating instance_info_cache with network_info: [{"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-changed-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Refreshing instance network info cache due to event network-changed-1643285b-2fcb-4065-b5e8-9aa786078d29. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] Acquiring lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] Acquired lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.network.neutron [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Refreshing network info cache for port 1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-d6e60f36-36c7-4a39-865c-43d902ef2a6b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.network.neutron [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updated VIF entry in instance network info cache for port 1643285b-2fcb-4065-b5e8-9aa786078d29. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG nova.network.neutron [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updating instance_info_cache with network_info: [{"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5d0a98ba-d6b9-4fe9-87ef-d644f4598f92 req-fb162335-0836-432f-83a7-eade4d444316 service nova] Releasing lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] No waiting events found dispatching network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:18 user nova-compute[70375]: WARNING nova.compute.manager [req-107293ce-2bf2-4575-90e7-f9de90082f11 req-22eac23e-b5f9-40ee-aaa4-3fbb1a4aa139 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received unexpected event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc for instance with vm_state building and task_state spawning.
Jul 24 17:48:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] No waiting events found dispatching network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:18 user nova-compute[70375]: WARNING nova.compute.manager [req-9c24bb0b-9403-4a44-82e6-ba82bba4d11f req-a8b5ba42-fb13-47b0-9f96-3064ef900048 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received unexpected event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 for instance with vm_state building and task_state spawning.
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220899.0804095, 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] VM Resumed (Lifecycle Event)
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Instance spawned successfully.
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220899.0908842, 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] VM Started (Lifecycle Event)
Jul 24 17:48:19 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Took 10.37 seconds to spawn the instance on the hypervisor.
Jul 24 17:48:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:19 user nova-compute[70375]: INFO nova.compute.manager [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Took 12.11 seconds to build instance.
Jul 24 17:48:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0431e215-f627-4218-97b0-b3361c7a85fc tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.279s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] No waiting events found dispatching network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:48:20 user nova-compute[70375]: WARNING nova.compute.manager [req-6d293863-7a16-432b-a410-912c5e9d7a25 req-ddd79f9e-a3ca-4901-9da9-286577dc4cf9 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received unexpected event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 for instance with vm_state building and task_state spawning.
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220900.9794145, baeaab3c-ddf0-408f-b148-1afc070a32f6 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:20 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] VM Resumed (Lifecycle Event)
Jul 24 17:48:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Instance spawned successfully.
Jul 24 17:48:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220900.9796276, baeaab3c-ddf0-408f-b148-1afc070a32f6 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:48:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] VM Started (Lifecycle Event)
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:48:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:48:21 user nova-compute[70375]: INFO nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Took 8.63 seconds to spawn the instance on the hypervisor.
Jul 24 17:48:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:48:21 user nova-compute[70375]: INFO nova.compute.manager [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Took 9.74 seconds to build instance.
Jul 24 17:48:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-091e34a7-6776-4520-bc5f-4ff06ef60627 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.064s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.874s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json" returned: 0 in 0.442s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:28 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:28 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=24.639022827148438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d6e60f36-36c7-4a39-865c-43d902ef2a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a32f2c47-1d35-4436-9da4-7c94de7ed79c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance baeaab3c-ddf0-408f-b148-1afc070a32f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:48:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:48:29 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:48:29 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:48:29 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:48:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.208s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:48:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:48:51 user nova-compute[70375]: INFO nova.compute.claims [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Claim successful on node user
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:48:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:48:52 user nova-compute[70375]: INFO nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Booting with volume e825b49c-a556-46ef-82e2-00b900f0623e at /dev/vda
Jul 24 17:48:52 user nova-compute[70375]: DEBUG nova.policy [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6df7f047b82446c887ac315c2dd9661d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa669d08f14f415b945c7bd94d10fc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:48:52 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:48:52 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpewtqn7_f/privsep.sock']
Jul 24 17:48:52 user sudo[81396]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpewtqn7_f/privsep.sock
Jul 24 17:48:52 user sudo[81396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 17:48:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully created port: 3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully created port: c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully created port: 52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:54 user sudo[81396]: pam_unix(sudo:session): session closed for user root
Jul 24 17:48:54 user nova-compute[70375]: INFO oslo.privsep.daemon [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Spawned new privsep daemon via rootwrap
Jul 24 17:48:54 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 17:48:54 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 17:48:54 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 24 17:48:54 user nova-compute[70375]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81399
Jul 24 17:48:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e5d55-3665-4994-bd7a-ab70bc8bed78]: (2,) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[613aa997-e2fa-4ba5-bd9a-52a7ca9fb81a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.nvmeof [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0272e4-5181-436c-bd46-bce41a66694a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6afc2b-6ed5-4df1-8748-a652f871366f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e53254-b7a5-4238-aaed-97278ec49ff2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:48:55 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:48:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[15508901-d0d5-4cd6-934c-11dc20f36e3c]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== get_connector_properties: return (2512ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating existing volume attachment record: 034e68f0-5ea1-4233-97e7-82b61f7c4559 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:48:55 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully created port: 8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully created port: eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: 3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-3bd8a854-b8bd-4887-b966-6a6218521b93. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port 3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cd20c6b1-9ce5-4ed1-a003-3238f08870bd req-362b35f7-27cf-483c-b8e5-df1e53c6cda6 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: 0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-e65168c4-db5e-4041-aa1d-f64f8ff3beb0. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-0244096a-6108-4654-b248-11efca5e5c96. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port 0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:48:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e5cddba-7c36-4ecb-a151-41fce06645dd req-7502d820-a270-4c7f-adc1-8186becc0507 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: 52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-c14ca673-d1a7-45fb-872f-e9de56e9c7e5. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-52d09f27-1319-4c49-8720-74ad6d4551cf. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port 52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: 8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:02 user nova-compute[70375]: INFO nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Booting with volume ba776a95-7068-4f8c-a5c1-634aa40416d0 at /dev/vdb
Jul 24 17:49:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ad06abd-9613-4048-82cd-d5b3745a6d61 req-ad3078be-bed7-4286-96bc-d2862eebcc25 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0662b734-d5cb-48c6-b9c7-660441d69783]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2a5603-5553-4712-8f0e-63958f3ae8db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77c6772-1673-4e36-9c8c-7b259cfd0591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067f7b4-a6e6-464f-aeca-8ef1b66c22f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:02 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:49:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39316c7-7605-451a-816e-a58eb1ba0505]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:02 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating existing volume attachment record: 7cd445a3-7ff4-4d9d-91a3-2facfe3f78f7 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-8644f057-dd43-48a5-9da7-1ea5da6b61c5. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port 8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Successfully updated port: eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6a7c4f90-92b2-42be-af95-9a3e1db083e8 req-5c593709-cb1c-4079-9e0e-21342edafbe4 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:49:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-eb995f09-e7f4-4fe6-84c5-a4659a0666cd. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance network_info: |[{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updated VIF entry in instance network info cache for port eb995f09-e7f4-4fe6-84c5-a4659a0666cd. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3862eb44-3c7b-41b5-a04d-39f433bb8645 req-288ad189-13a1-4661-82d4-a7c8acfe8594 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:09 user nova-compute[70375]: INFO nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Booting with volume 4952d2cf-4c45-4146-bb39-8e12c82b14e4 at /dev/vdc
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[639605a0-7333-4fc3-b506-015893ae7cab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[17144605-8817-4291-9aaa-98855be90bf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ed5d3-ccbd-42db-b2fc-631a940d6d28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc8843-afdc-4c96-8372-31cdb77ca9fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:09 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:49:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b5aea2-1f55-4f9c-a5cb-65a9cc0ebb75]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG os_brick.utils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:09 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating existing volume attachment record: a5c40114-bfb0-4077-b6a5-66a60796a8c1 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:49:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lazy-loading 'flavor' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:13 user nova-compute[70375]: INFO nova.compute.manager [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Attaching volume c25219d4-e8dc-40dd-a723-0526c2bd1816 to /dev/vdb
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.utils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a32d5-fbee-43e5-8f36-f4fc7c0f0100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931aad1-2890-4062-a51d-5fdae65e3cd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f23ea-e0d1-4276-aef7-7148606417fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eededcee-a08d-4024-99d6-d089261b6ebb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:13 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:49:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[28120627-f79a-4ae4-a713-6ec7ecc30a2a]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG os_brick.utils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:13 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updating existing volume attachment record: 17d53e67-f168-4bbe-8363-f2ed332f243f {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:49:15 user nova-compute[70375]: INFO nova.compute.claims [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Claim successful on node user
Jul 24 17:49:15 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:49:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.policy [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a249d8642e364aa09f5d9e5578a30567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f5e68e0c44a5f890f0901df3b71b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:49:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Creating image(s)
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "/opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "/opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "/opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.172s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk 1073741824" returned: 0 in 0.058s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Successfully created port: efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Cannot resize image /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'migration_context' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Ensure instance console log exists: /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Successfully updated port: efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquired lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-changed-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Refreshing instance network info cache due to event network-changed-efb07c38-8d48-4a2e-a178-360ba9cc30d2. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] Acquiring lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating instance_info_cache with network_info: [{"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Releasing lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Instance network_info: |[{"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] Acquired lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Refreshing network info cache for port efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Start _get_guest_xml network_info=[{"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:49:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1409292148',display_name='tempest-VolumesSnapshotTestJSON-instance-1409292148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1409292148',id=11,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKRE82jKxaaJadLhwv/5SqYJSooBCCa0+eR/1MUgpOjH7ks7lm45KCTrFvtVpdd/Ad9jNtZE5Yor3hOmV6Odm3zrxxQCyPYDZm1GiCb+bTjQsTBjVaNORz0DnfbcGX9jA==',key_name='tempest-keypair-2121430496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-uca84o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=823fa668-f964-4574-aeec-009ceb0cdc40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'pci_devices' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:49:18 user nova-compute[70375]:   <uuid>823fa668-f964-4574-aeec-009ceb0cdc40</uuid>
Jul 24 17:49:18 user nova-compute[70375]:   <name>instance-0000000b</name>
Jul 24 17:49:18 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:49:18 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:49:18 user nova-compute[70375]:   <metadata>
Jul 24 17:49:18 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:49:18 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1409292148</nova:name>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:49:18</nova:creationTime>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:49:18 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:49:18 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:owner>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:user uuid="a249d8642e364aa09f5d9e5578a30567">tempest-VolumesSnapshotTestJSON-2081775558-project-member</nova:user>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:project uuid="941f5e68e0c44a5f890f0901df3b71b6">tempest-VolumesSnapshotTestJSON-2081775558</nova:project>
Jul 24 17:49:18 user nova-compute[70375]:       </nova:owner>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:49:18 user nova-compute[70375]:       <nova:ports>
Jul 24 17:49:18 user nova-compute[70375]:         <nova:port uuid="efb07c38-8d48-4a2e-a178-360ba9cc30d2">
Jul 24 17:49:18 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:49:18 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:18 user nova-compute[70375]:       </nova:ports>
Jul 24 17:49:18 user nova-compute[70375]:     </nova:instance>
Jul 24 17:49:18 user nova-compute[70375]:   </metadata>
Jul 24 17:49:18 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:49:18 user nova-compute[70375]:     <system>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="serial">823fa668-f964-4574-aeec-009ceb0cdc40</entry>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="uuid">823fa668-f964-4574-aeec-009ceb0cdc40</entry>
Jul 24 17:49:18 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:49:18 user nova-compute[70375]:     </system>
Jul 24 17:49:18 user nova-compute[70375]:   </sysinfo>
Jul 24 17:49:18 user nova-compute[70375]:   <os>
Jul 24 17:49:18 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:49:18 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:49:18 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:49:18 user nova-compute[70375]:   </os>
Jul 24 17:49:18 user nova-compute[70375]:   <features>
Jul 24 17:49:18 user nova-compute[70375]:     <acpi/>
Jul 24 17:49:18 user nova-compute[70375]:     <apic/>
Jul 24 17:49:18 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:49:18 user nova-compute[70375]:   </features>
Jul 24 17:49:18 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:49:18 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:49:18 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:49:18 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:49:18 user nova-compute[70375]:   </clock>
Jul 24 17:49:18 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:49:18 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:49:18 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:49:18 user nova-compute[70375]:   </cpu>
Jul 24 17:49:18 user nova-compute[70375]:   <devices>
Jul 24 17:49:18 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:49:18 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:49:18 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk"/>
Jul 24 17:49:18 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:49:18 user nova-compute[70375]:     </disk>
Jul 24 17:49:18 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:18 user nova-compute[70375]:       <mac address="fa:16:3e:db:dc:02"/>
Jul 24 17:49:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:18 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:18 user nova-compute[70375]:       <target dev="tapefb07c38-8d"/>
Jul 24 17:49:18 user nova-compute[70375]:     </interface>
Jul 24 17:49:18 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:49:18 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/console.log" append="off"/>
Jul 24 17:49:18 user nova-compute[70375]:     </serial>
Jul 24 17:49:18 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:49:18 user nova-compute[70375]:     <video>
Jul 24 17:49:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:18 user nova-compute[70375]:     </video>
Jul 24 17:49:18 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:49:18 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:49:18 user nova-compute[70375]:     </rng>
Jul 24 17:49:18 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:49:18 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:49:18 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:49:18 user nova-compute[70375]:     </memballoon>
Jul 24 17:49:18 user nova-compute[70375]:   </devices>
Jul 24 17:49:18 user nova-compute[70375]: </domain>
Jul 24 17:49:18 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1409292148',display_name='tempest-VolumesSnapshotTestJSON-instance-1409292148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1409292148',id=11,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKRE82jKxaaJadLhwv/5SqYJSooBCCa0+eR/1MUgpOjH7ks7lm45KCTrFvtVpdd/Ad9jNtZE5Yor3hOmV6Odm3zrxxQCyPYDZm1GiCb+bTjQsTBjVaNORz0DnfbcGX9jA==',key_name='tempest-keypair-2121430496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-uca84o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=823fa668-f964-4574-aeec-009ceb0cdc40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG os_vif [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefb07c38-8d, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefb07c38-8d, col_values=(('external_ids', {'iface-id': 'efb07c38-8d48-4a2e-a178-360ba9cc30d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:dc:02', 'vm-uuid': '823fa668-f964-4574-aeec-009ceb0cdc40'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:18 user nova-compute[70375]: INFO os_vif [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d')
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No VIF found with MAC fa:16:3e:db:dc:02, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updated VIF entry in instance network info cache for port efb07c38-8d48-4a2e-a178-360ba9cc30d2. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating instance_info_cache with network_info: [{"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cfc99336-2d92-4cb1-81f1-704b3a4c6619 req-7caaaded-c1df-495c-9f58-6fa7d03d7dbe service nova] Releasing lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] No waiting events found dispatching network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:20 user nova-compute[70375]: WARNING nova.compute.manager [req-c3db782d-449a-43de-b62c-dbe980e5f6b4 req-eca63328-7ff6-4f02-84ee-b71a5496a5c0 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received unexpected event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 for instance with vm_state building and task_state spawning.
Jul 24 17:49:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:49:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Creating image(s)
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Ensure instance console log exists: /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Start _get_guest_xml network_info=[{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '034e68f0-5ea1-4233-97e7-82b61f7c4559', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzMLGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ad9c9c1-db8a-4718-98bf-efc13341efe2', 'attached_at': '', 'detached_at': '', 'volume_id': 'e825b49c-a556-46ef-82e2-00b900f0623e', 'serial': 'e825b49c-a556-46ef-82e2-00b900f0623e'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '7cd445a3-7ff4-4d9d-91a3-2facfe3f78f7', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwTUmFqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ad9c9c1-db8a-4718-98bf-efc13341efe2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba776a95-7068-4f8c-a5c1-634aa40416d0', 'serial': 'ba776a95-7068-4f8c-a5c1-634aa40416d0'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'a5c40114-bfb0-4077-b6a5-66a60796a8c1', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYSFvMNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ad9c9c1-db8a-4718-98bf-efc13341efe2', 'attached_at': '', 'detached_at': '', 'volume_id': '4952d2cf-4c45-4146-bb39-8e12c82b14e4', 'serial': '4952d2cf-4c45-4146-bb39-8e12c82b14e4'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connector [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Factory for ISCSI on None {{(pid=70375) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzMLGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:20 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:20 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:20 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a442c2-96a8-4cca-af92-9c28f8f33e18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:49:20 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[44da4296-c50d-462f-9d0f-d66e9dbd786c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e] added
Jul 24 17:49:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d9dc0-eda5-47b9-adc5-315fd07b9639]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[69167edf-97d5-446f-81c5-21587b492382]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzMLGkiO {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzMLGkiO" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[552454c7-45e0-4751-8dcd-dd7fcd4905bf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzMLGkiO'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3390417f-b084-4d36-acc8-10e7299aa130]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fb8f2e-b72f-4386-9bb0-fa0fe6026beb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:49:20 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:49:20 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:20 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 17:49:20 user nova-compute[70375]: 
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[01adb7db-22b2-4ff4-b533-6746ec64a6da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260]
Jul 24 17:49:20 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c12d5-7fee-48da-b473-0c290bf1b3f8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c852d7-43d6-4220-8def-65a7ca19456e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8782133-9f77-4acf-a261-43806304d7b8]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyFAhKbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:21 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzMLGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23561326136323764', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561326136323764', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.780s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:22 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[76319fc4-fe50-4d7a-a40d-6dd578eea5b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:49:22 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwTUmFqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08759d-433b-4b98-8b42-c1af56be2a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816] added
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b9bfba-53b8-4ca0-926f-663cd6ffa52a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587755b-94f2-4f05-8399-f2338d88f1a0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyFAhKbl {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220962.1770895, 823fa668-f964-4574-aeec-009ceb0cdc40 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] VM Resumed (Lifecycle Event)
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyFAhKbl" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51dda7b-ddd7-451b-8553-f76134beb62a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyFAhKbl'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Instance spawned successfully.
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220962.1776106, 823fa668-f964-4574-aeec-009ceb0cdc40 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] VM Started (Lifecycle Event)
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31625589-4fe7-4f2f-b539-aa434870db7c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac161d9-1efe-4f2f-9eca-20f03753abca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Took 6.12 seconds to spawn the instance on the hypervisor.
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df6550-22d8-4ebc-a7a5-8fb78b7f8c10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260]
Jul 24 17:49:22 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f8864-eae2-46b0-a387-4a75ee17e13a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f2ccf-85f1-444a-9bd7-dcfbe4e11c62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:22 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:22 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b2efd-ae73-44bc-a021-d1a3e4adc2be]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyFAhKbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:49:22 user nova-compute[70375]: INFO nova.compute.manager [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Took 7.00 seconds to build instance.
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] No waiting events found dispatching network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:22 user nova-compute[70375]: WARNING nova.compute.manager [req-acbff297-8359-4b61-9e00-85de18a75eea req-3658be79-17b9-4492-84b3-dc5081dfaff4 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received unexpected event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 for instance with vm_state active and task_state None.
Jul 24 17:49:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c91b9b04-6ade-4a7a-8650-9cc2e80656f5 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] <== connect_volume: return (2125ms) {'type': 'block', 'scsi_wwn': '26330613563363566', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330613563363566', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.319s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:23 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:23 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lazy-loading 'flavor' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf91d8a-b770-4997-b57b-bfa89d12c084]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:49:23 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[22acdd78-4995-4883-bd11-8fc208f9c4f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0] added
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4ab40-e70c-4c84-9262-9dcc16b669a1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:49:23 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:49:23 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:49:23 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:49:23 user nova-compute[70375]:   <serial>c25219d4-e8dc-40dd-a723-0526c2bd1816</serial>
Jul 24 17:49:23 user nova-compute[70375]: </disk>
Jul 24 17:49:23 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[460df45f-9a6f-4030-96fc-26a81be64c48]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwTUmFqr {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwTUmFqr" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97830b3-f6c9-4cde-b7e7-e26d027575c1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwTUmFqr'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad55a286-3cab-4520-9ab1-195488e045ec]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb572c-566e-4e26-9670-badd8caf2df9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307fbc0-43e3-49f0-b159-88f5ec05e0ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260]
Jul 24 17:49:23 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189df44-3b00-4056-ae02-08f33d2569bd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c976526-7add-4b1b-b5c3-e7a69ff6434a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e39ec-5784-41e0-a4f9-dbab63f1e67b]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] No VIF found with MAC fa:16:3e:62:64:a8, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1b2b2b55-766a-4f79-9c01-9ad7a0cd28af tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.781s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:24 user nova-compute[70375]: INFO nova.compute.manager [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Rescuing
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:24 user nova-compute[70375]: INFO nova.compute.manager [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Terminating instance
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwTUmFqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== connect_volume: return (2762ms) {'type': 'block', 'scsi_wwn': '23538373464666661', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373464666661', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYSFvMNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:24 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:24 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:24 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7329552-afbb-4a00-9496-d4c5b52809fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:49:24 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.046s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[346c6c67-ae4c-40c1-8a20-269a65b92bae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4] added
Jul 24 17:49:24 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[035fc392-b438-4856-b4cb-50cffcca4a9a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f56e5-4684-43e9-a330-4be51467f03c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYSFvMNa {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYSFvMNa" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d35582-4bbd-4d5d-af7f-c66d1934c40b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYSFvMNa'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce754a-2ef1-4bf1-acdf-b730401663e8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c338e681-293b-46b9-a262-1c660c8dd236]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd9d6b4-5bd7-4f40-b236-89d531d5d784]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260]
Jul 24 17:49:25 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[628dce7e-c8f3-431f-ba8d-d53f6ed2f6d9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1b4eb-9745-498b-a51a-b57b3d807660]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea655a-4ab3-40ef-9cff-4836ee2bd007]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYSFvMNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-unplugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] No waiting events found dispatching network-vif-unplugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-c98a41fa-aaea-458a-9ca5-1e651962e04a req-f39488d1-b510-4788-893b-dd38960404ee service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-unplugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:49:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Instance destroyed successfully.
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lazy-loading 'resources' on Instance uuid d6e60f36-36c7-4a39-865c-43d902ef2a6b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-563552932',display_name='tempest-DeleteServersTestJSON-server-563552932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-563552932',id=1,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba9d7ccdc734305a3a13267d64dfeaf',ramdisk_id='',reservation_id='r-n037tumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1371215078',owner_user_name='tempest-DeleteServersTestJSON-1371215078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:47:35Z,user_data=None,user_id='04cf2a8b04e14668861ec365938413d9',uuid=d6e60f36-36c7-4a39-865c-43d902ef2a6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converting VIF {"id": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "address": "fa:16:3e:62:64:a8", "network": {"id": "ec6a8f8f-a03e-4c23-8f04-c7d76f22b006", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1803010360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba9d7ccdc734305a3a13267d64dfeaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3005cc-99", "ovs_interfaceid": "cc3005cc-99d8-43e6-b0e8-1c67c9f2369c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_vif [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc3005cc-99, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:25 user nova-compute[70375]: INFO os_vif [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=cc3005cc-99d8-43e6-b0e8-1c67c9f2369c,network=Network(ec6a8f8f-a03e-4c23-8f04-c7d76f22b006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3005cc-99')
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyFAhKbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG nova.network.neutron [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '23738386537663465', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738386537663465', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.774s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0012fec3-5cd9-4a17-9d51-43de8f762439]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:49:26 user nova-compute[70375]: No targets found.
Jul 24 17:49:26 user nova-compute[70375]: iSNS:
Jul 24 17:49:26 user nova-compute[70375]: No targets found.
Jul 24 17:49:26 user nova-compute[70375]: STATIC:
Jul 24 17:49:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:49:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:49:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:49:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816
Jul 24 17:49:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:49:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:49:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:49:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:49:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:49:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:49:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:49:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:49:26 user nova-compute[70375]: FIRMWARE:
Jul 24 17:49:26 user nova-compute[70375]: No targets found.
Jul 24 17:49:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:49:26 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:49:26 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ad9c9c1-db8a-4718-98bf-efc13341efe2 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e49f8a-c862-40fe-9c6c-f4f692514e5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:49:26 user nova-compute[70375]:   <uuid>4ad9c9c1-db8a-4718-98bf-efc13341efe2</uuid>
Jul 24 17:49:26 user nova-compute[70375]:   <name>instance-0000000a</name>
Jul 24 17:49:26 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:49:26 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:49:26 user nova-compute[70375]:   <metadata>
Jul 24 17:49:26 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:49:26 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:name>tempest-device-tagging-server-2135240199</nova:name>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:49:20</nova:creationTime>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:49:26 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:49:26 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:owner>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:user uuid="6df7f047b82446c887ac315c2dd9661d">tempest-TaggedBootDevicesTest_v242-623693073-project-member</nova:user>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:project uuid="aa669d08f14f415b945c7bd94d10fc0a">tempest-TaggedBootDevicesTest_v242-623693073</nova:project>
Jul 24 17:49:26 user nova-compute[70375]:       </nova:owner>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:49:26 user nova-compute[70375]:       <nova:ports>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="3bd8a854-b8bd-4887-b966-6a6218521b93">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="e65168c4-db5e-4041-aa1d-f64f8ff3beb0">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="0244096a-6108-4654-b248-11efca5e5c96">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="c14ca673-d1a7-45fb-872f-e9de56e9c7e5">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="52d09f27-1319-4c49-8720-74ad6d4551cf">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="8644f057-dd43-48a5-9da7-1ea5da6b61c5">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:         <nova:port uuid="eb995f09-e7f4-4fe6-84c5-a4659a0666cd">
Jul 24 17:49:26 user nova-compute[70375]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 17:49:26 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:26 user nova-compute[70375]:       </nova:ports>
Jul 24 17:49:26 user nova-compute[70375]:     </nova:instance>
Jul 24 17:49:26 user nova-compute[70375]:   </metadata>
Jul 24 17:49:26 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:49:26 user nova-compute[70375]:     <system>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="serial">4ad9c9c1-db8a-4718-98bf-efc13341efe2</entry>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="uuid">4ad9c9c1-db8a-4718-98bf-efc13341efe2</entry>
Jul 24 17:49:26 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:49:26 user nova-compute[70375]:     </system>
Jul 24 17:49:26 user nova-compute[70375]:   </sysinfo>
Jul 24 17:49:26 user nova-compute[70375]:   <os>
Jul 24 17:49:26 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:49:26 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:49:26 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:49:26 user nova-compute[70375]:   </os>
Jul 24 17:49:26 user nova-compute[70375]:   <features>
Jul 24 17:49:26 user nova-compute[70375]:     <acpi/>
Jul 24 17:49:26 user nova-compute[70375]:     <apic/>
Jul 24 17:49:26 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:49:26 user nova-compute[70375]:   </features>
Jul 24 17:49:26 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:49:26 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:49:26 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:49:26 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:49:26 user nova-compute[70375]:   </clock>
Jul 24 17:49:26 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:49:26 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:49:26 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:49:26 user nova-compute[70375]:   </cpu>
Jul 24 17:49:26 user nova-compute[70375]:   <devices>
Jul 24 17:49:26 user nova-compute[70375]:     <disk type="file" device="cdrom">
Jul 24 17:49:26 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 17:49:26 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/disk.config"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="hda" bus="ide"/>
Jul 24 17:49:26 user nova-compute[70375]:     </disk>
Jul 24 17:49:26 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:49:26 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:49:26 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <serial>e825b49c-a556-46ef-82e2-00b900f0623e</serial>
Jul 24 17:49:26 user nova-compute[70375]:     </disk>
Jul 24 17:49:26 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:49:26 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:49:26 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <serial>ba776a95-7068-4f8c-a5c1-634aa40416d0</serial>
Jul 24 17:49:26 user nova-compute[70375]:     </disk>
Jul 24 17:49:26 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:49:26 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:49:26 user nova-compute[70375]:       <source dev="/dev/sde"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="vdc" bus="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <serial>4952d2cf-4c45-4146-bb39-8e12c82b14e4</serial>
Jul 24 17:49:26 user nova-compute[70375]:     </disk>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:61:94:1f"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tap3bd8a854-b8"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:c5:fb:75"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tape65168c4-db"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:82:bc:29"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tap0244096a-61"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:1c:1c:6e"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tapc14ca673-d1"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:33:96:b9"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tap52d09f27-13"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:52:97:b5"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tap8644f057-dd"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:26 user nova-compute[70375]:       <mac address="fa:16:3e:2b:24:ee"/>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:26 user nova-compute[70375]:       <target dev="tapeb995f09-e7"/>
Jul 24 17:49:26 user nova-compute[70375]:     </interface>
Jul 24 17:49:26 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:49:26 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/console.log" append="off"/>
Jul 24 17:49:26 user nova-compute[70375]:     </serial>
Jul 24 17:49:26 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:49:26 user nova-compute[70375]:     <video>
Jul 24 17:49:26 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:26 user nova-compute[70375]:     </video>
Jul 24 17:49:26 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:49:26 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:49:26 user nova-compute[70375]:     </rng>
Jul 24 17:49:26 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:49:26 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:49:26 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:49:26 user nova-compute[70375]:     </memballoon>
Jul 24 17:49:26 user nova-compute[70375]:   </devices>
Jul 24 17:49:26 user nova-compute[70375]: </domain>
Jul 24 17:49:26 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bd8a854-b8, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bd8a854-b8, col_values=(('external_ids', {'iface-id': '3bd8a854-b8bd-4887-b966-6a6218521b93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:94:1f', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e17da3-f9dc-422d-9f81-1e369b97f857]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6481f37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8')
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape65168c4-db, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape65168c4-db, col_values=(('external_ids', {'iface-id': 'e65168c4-db5e-4041-aa1d-f64f8ff3beb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:fb:75', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[35634c08-3bcf-4995-a27b-56856e42299c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd9f04-3a89-4c91-b830-e9f2b11eff04]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:49:26 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db')
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0244096a-61, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0244096a-61, col_values=(('external_ids', {'iface-id': '0244096a-6108-4654-b248-11efca5e5c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:bc:29', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ccf2d-57f5-4cfe-ad12-a84782b8ba86]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61')
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc14ca673-d1, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc14ca673-d1, col_values=(('external_ids', {'iface-id': 'c14ca673-d1a7-45fb-872f-e9de56e9c7e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:1c:6e', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec4296-d1e0-4f4d-bdde-cacacfa899ba]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:26 user nova-compute[70375]: WARNING nova.compute.manager [req-02cd26fc-5899-49c2-8b0e-b1ee623d9130 req-5fbd30e9-1374-4d4b-b4bf-72963f803f07 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state active and task_state rescuing.
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeddd16e-069d-4efc-a331-d467506d91f4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1')
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dcbed3-a6bb-4cfb-a00b-d174564d87f8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260]
Jul 24 17:49:26 user nova-compute[70375]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52d09f27-13, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52d09f27-13, col_values=(('external_ids', {'iface-id': '52d09f27-1319-4c49-8720-74ad6d4551cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:96:b9', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25219d4-e8dc-40dd-a723-0526c2bd1816 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed838b5-6a9f-49c3-9e59-f6cf8f433e10]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] <== disconnect_volume: return (1263ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:49:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Deleting instance files /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b_del
Jul 24 17:49:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Deletion of /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b_del complete
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13')
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json" returned: 1 in 0.192s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk --force-share --output=json' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8644f057-dd, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8644f057-dd, col_values=(('external_ids', {'iface-id': '8644f057-dd43-48a5-9da7-1ea5da6b61c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:97:b5', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:26 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000001, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/d6e60f36-36c7-4a39-865c-43d902ef2a6b/disk
Jul 24 17:49:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance destroyed successfully.
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Attempting rescue
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Creating image(s)
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'trusted_certs' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70375) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.host [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] UEFI support detected
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:27 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd')
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.compute.manager [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Took 2.38 seconds to destroy the instance on the hypervisor.
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb995f09-e7, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb995f09-e7, col_values=(('external_ids', {'iface-id': 'eb995f09-e7f4-4fe6-84c5-a4659a0666cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:24:ee', 'vm-uuid': '4ad9c9c1-db8a-4718-98bf-efc13341efe2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:27 user nova-compute[70375]: INFO os_vif [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7')
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.210s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue" returned: 0 in 0.058s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] No BDM found with device name hda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] No VIF found with MAC fa:16:3e:61:94:1f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] No VIF found with MAC fa:16:3e:33:96:b9, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Using config drive
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start _get_guest_xml network_info=[{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:10:a3:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'numa_topology' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] Acquiring lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] No waiting events found dispatching network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:27 user nova-compute[70375]: WARNING nova.compute.manager [req-b880e03c-30dc-4fe0-bc63-48bc14cfe55f req-25734684-432f-46d2-a6b1-43851041c599 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received unexpected event network-vif-plugged-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c for instance with vm_state active and task_state deleting.
Jul 24 17:49:27 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:27 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'vcpu_model' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1209451013',display_name='tempest-ServerRescueNegativeTestJSON-server-1209451013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1209451013',id=3,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-jk7mh80o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:48Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=f45c7f1d-bb87-42a6-a988-97d80a96225b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:10:a3:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:10:a3:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:49:27 user nova-compute[70375]:   <uuid>f45c7f1d-bb87-42a6-a988-97d80a96225b</uuid>
Jul 24 17:49:27 user nova-compute[70375]:   <name>instance-00000003</name>
Jul 24 17:49:27 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:49:27 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:49:27 user nova-compute[70375]:   <metadata>
Jul 24 17:49:27 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:49:27 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1209451013</nova:name>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:49:27</nova:creationTime>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:49:27 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:49:27 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:owner>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:49:27 user nova-compute[70375]:       </nova:owner>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:49:27 user nova-compute[70375]:       <nova:ports>
Jul 24 17:49:27 user nova-compute[70375]:         <nova:port uuid="ff87540f-1409-4b8e-a753-248a19b7836f">
Jul 24 17:49:27 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:49:27 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:27 user nova-compute[70375]:       </nova:ports>
Jul 24 17:49:27 user nova-compute[70375]:     </nova:instance>
Jul 24 17:49:27 user nova-compute[70375]:   </metadata>
Jul 24 17:49:27 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:49:27 user nova-compute[70375]:     <system>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="serial">f45c7f1d-bb87-42a6-a988-97d80a96225b</entry>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="uuid">f45c7f1d-bb87-42a6-a988-97d80a96225b</entry>
Jul 24 17:49:27 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:49:27 user nova-compute[70375]:     </system>
Jul 24 17:49:27 user nova-compute[70375]:   </sysinfo>
Jul 24 17:49:27 user nova-compute[70375]:   <os>
Jul 24 17:49:27 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:49:27 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:49:27 user nova-compute[70375]:   </os>
Jul 24 17:49:27 user nova-compute[70375]:   <features>
Jul 24 17:49:27 user nova-compute[70375]:     <acpi/>
Jul 24 17:49:27 user nova-compute[70375]:     <apic/>
Jul 24 17:49:27 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:49:27 user nova-compute[70375]:   </features>
Jul 24 17:49:27 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:49:27 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:49:27 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:49:27 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:49:27 user nova-compute[70375]:   </clock>
Jul 24 17:49:27 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:49:27 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:49:27 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:49:27 user nova-compute[70375]:   </cpu>
Jul 24 17:49:27 user nova-compute[70375]:   <devices>
Jul 24 17:49:27 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:49:27 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:49:27 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue"/>
Jul 24 17:49:27 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:49:27 user nova-compute[70375]:     </disk>
Jul 24 17:49:27 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:49:27 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:49:27 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk"/>
Jul 24 17:49:27 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:49:27 user nova-compute[70375]:     </disk>
Jul 24 17:49:27 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:27 user nova-compute[70375]:       <mac address="fa:16:3e:10:a3:54"/>
Jul 24 17:49:27 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:27 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:27 user nova-compute[70375]:       <target dev="tapff87540f-14"/>
Jul 24 17:49:27 user nova-compute[70375]:     </interface>
Jul 24 17:49:27 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:49:27 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/console.log" append="off"/>
Jul 24 17:49:27 user nova-compute[70375]:     </serial>
Jul 24 17:49:27 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:49:27 user nova-compute[70375]:     <video>
Jul 24 17:49:27 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:27 user nova-compute[70375]:     </video>
Jul 24 17:49:27 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:49:27 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:49:27 user nova-compute[70375]:     </rng>
Jul 24 17:49:27 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:49:27 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:49:27 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:49:27 user nova-compute[70375]:     </memballoon>
Jul 24 17:49:27 user nova-compute[70375]:   </devices>
Jul 24 17:49:27 user nova-compute[70375]: </domain>
Jul 24 17:49:27 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance destroyed successfully.
Jul 24 17:49:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Creating config drive at /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/disk.config
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmvm121ms {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:10:a3:54, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmvm121ms" returned: 0 in 0.111s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-changed-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Refreshing instance network info cache due to event network-changed-7a90f720-81a5-4c3f-8127-09c271d8d51b. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] Acquiring lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] Acquired lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG nova.network.neutron [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Refreshing network info cache for port 7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:28 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Took 0.95 seconds to deallocate network for instance.
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:28 user nova-compute[70375]: WARNING nova.compute.manager [req-636eec68-dd3c-4d21-9fc8-1cc56f0008c0 req-d5499eef-fe78-499e-96cc-b370ab242540 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state active and task_state rescuing.
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG nova.network.neutron [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updated VIF entry in instance network info cache for port 7a90f720-81a5-4c3f-8127-09c271d8d51b. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG nova.network.neutron [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating instance_info_cache with network_info: [{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:29 user nova-compute[70375]: INFO nova.compute.manager [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Took 1.03 seconds to detach 1 volumes for instance.
Jul 24 17:49:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-557ff8cc-3574-4147-a7f1-181f3078eaf4 req-5fe76317-464c-496e-ad0e-c3596595d04e service nova] Releasing lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-33f01ae1-b942-456d-83a5-c20a3b28553f req-7e5e258c-05b4-4319-9d7c-7326aa34b098 service nova] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Received event network-vif-deleted-cc3005cc-99d8-43e6-b0e8-1c67c9f2369c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-7ef34c99-cbd0-447a-95cd-2a695bcacf77 req-10055cf8-6a4c-45cc-b44a-0530cd2e82a4 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-97f80ef8-7080-4c62-ac61-53077f6e5a4f req-04eee200-57d3-4e44-a564-2253261ede81 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-changed-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Refreshing instance network info cache due to event network-changed-68b0448f-d9ad-4486-9db5-9d9f1f626cae. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Refreshing network info cache for port 68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state active and task_state rescuing.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-45b7380a-1611-45ae-8603-633a9d4a9c6e req-b0417f79-986e-4d6c-a5af-7a203caefa0c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state active and task_state rescuing.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:34 user nova-compute[70375]: WARNING nova.compute.manager [req-f0e2c616-16b0-4133-9a23-91ed980b545c req-ee9534c4-c0a9-4704-976d-84e40496a920 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 for instance with vm_state building and task_state spawning.
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for f45c7f1d-bb87-42a6-a988-97d80a96225b due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 17:49:34 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220974.5492713, f45c7f1d-bb87-42a6-a988-97d80a96225b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] VM Resumed (Lifecycle Event)
Jul 24 17:49:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.compute.manager [req-ee690e71-f975-47fc-86ba-617d72303299 req-ee973ab5-a8a3-4395-8e45-3718ff3c5c4f service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd for instance with vm_state building and task_state spawning.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-12b4628c-2a06-4e66-a01d-43a4b0c8a103 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:35 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7039MB free_disk=24.528446197509766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 5.970s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.096s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220974.5510445, f45c7f1d-bb87-42a6-a988-97d80a96225b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] VM Started (Lifecycle Event)
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Deleted allocations for instance d6e60f36-36c7-4a39-865c-43d902ef2a6b
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.compute.manager [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Attaching volume b75085e2-d522-4114-85d4-4e9eb71a0d74 to /dev/vdb
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.utils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1cb0ea2b-e6f0-4384-bd76-e3502204a2cc tempest-DeleteServersTestJSON-1371215078 tempest-DeleteServersTestJSON-1371215078-project-member] Lock "d6e60f36-36c7-4a39-865c-43d902ef2a6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.818s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419229c-701e-4a74-b035-224385d7c79b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a32f2c47-1d35-4436-9da4-7c94de7ed79c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance baeaab3c-ddf0-408f-b148-1afc070a32f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 823fa668-f964-4574-aeec-009ceb0cdc40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e603a3-fd85-48b6-9ede-b8cc8582ba2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d4065-02eb-4122-add8-ae9a7956d49e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2952a0-bc3a-4692-a05a-0b9ebc194220]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:35 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:49:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdca2bf-b82f-41e8-8b43-68bb06c670da]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG os_brick.utils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating existing volume attachment record: d65983f8-6a28-4b1c-890b-9ed47f9fe81b {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220975.845126, 4ad9c9c1-db8a-4718-98bf-efc13341efe2 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] VM Resumed (Lifecycle Event)
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance spawned successfully.
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.network.neutron [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updated VIF entry in instance network info cache for port 68b0448f-d9ad-4486-9db5-9d9f1f626cae. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.network.neutron [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:36 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220975.8532398, 4ad9c9c1-db8a-4718-98bf-efc13341efe2 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:36 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] VM Started (Lifecycle Event)
Jul 24 17:49:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-640fb2fc-39b5-449d-8af5-9cf3380fe061 req-e7c61c56-689e-47b7-a26e-344b30a4441d service nova] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:36 user nova-compute[70375]: INFO nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Took 15.45 seconds to spawn the instance on the hypervisor.
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:36 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:49:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:49:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.968s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:36 user nova-compute[70375]: INFO nova.compute.manager [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Took 44.29 seconds to build instance.
Jul 24 17:49:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1140b3f8-0494-4caf-a311-fd8899382585 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.402s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:40 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690220965.546891, d6e60f36-36c7-4a39-865c-43d902ef2a6b => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:40 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] VM Stopped (Lifecycle Event)
Jul 24 17:49:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6bafac0-5162-4e84-b3f6-6a92e6df195c None None] [instance: d6e60f36-36c7-4a39-865c-43d902ef2a6b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:49:42 user nova-compute[70375]: INFO nova.compute.claims [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Claim successful on node user
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:49:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.policy [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7073c1a99c94606a7056d1ccf31c5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddac964fe7c5486d9a6b009e20de7890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:49:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Creating image(s)
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "/opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "/opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "/opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk 1073741824" returned: 0 in 0.054s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.191s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:49:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Cannot resize image /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'migration_context' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYuUtnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:44 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:44 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:49:44 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Ensure instance console log exists: /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e00a6-d3e7-4d30-90ec-6186f608f590]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:49:44 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[22339385-37aa-44e6-8fdc-5362750647af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74] added
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[77448f4a-849d-4a2e-bd59-03c565a4aa60]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Successfully created port: fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe008e79-8489-4802-9592-b8489f9a44c1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJYuUtnl {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJYuUtnl" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[65545c70-5089-4603-ac42-8cec2936d477]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJYuUtnl'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc3d0c4-f0b4-4b52-81a5-c1e7bbc2d1b3]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdf09dc-ede2-4c57-a787-6ee02d9427e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b683713-52d2-43a3-b6b1-54205ad97a75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260]
Jul 24 17:49:44 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260] successful.
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db07ee38-de55-467b-8b9c-eba741ca9dfb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4526113f-4dbd-4cec-becd-052f34ce97d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:49:44 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc2641-1446-4f4f-8ba3-c08540d9472f]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYuUtnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:49:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Successfully updated port: fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquired lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-changed-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Refreshing instance network info cache due to event network-changed-fba13bd2-e46f-40e4-bb80-1380bc67687d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] Acquiring lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updating instance_info_cache with network_info: [{"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Releasing lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Instance network_info: |[{"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] Acquired lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Refreshing network info cache for port fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Start _get_guest_xml network_info=[{"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:49:45 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:45 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173480',id=12,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+mf4MojBWbx7ndQUqWJiOqyxKTJ0i/MARuffrrP6deCbGyYPBV1Knp2xLIoTZkuys68QPZJQj0tyabqCZLnwJ2Gclu/zA1hjTodLRy2cNwr0KAQ7f7lZXcHSUTZEAmEQ==',key_name='tempest-keypair-545366782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddac964fe7c5486d9a6b009e20de7890',ramdisk_id='',reservation_id='r-3evkzdyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7073c1a99c94606a7056d1ccf31c5cc',uuid=23c835be-30a5-4353-ac0a-dca4c53e7921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converting VIF {"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'pci_devices' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:49:45 user nova-compute[70375]:   <uuid>23c835be-30a5-4353-ac0a-dca4c53e7921</uuid>
Jul 24 17:49:45 user nova-compute[70375]:   <name>instance-0000000c</name>
Jul 24 17:49:45 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:49:45 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:49:45 user nova-compute[70375]:   <metadata>
Jul 24 17:49:45 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:49:45 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197</nova:name>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:49:45</nova:creationTime>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:49:45 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:49:45 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:owner>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:user uuid="b7073c1a99c94606a7056d1ccf31c5cc">tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member</nova:user>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:project uuid="ddac964fe7c5486d9a6b009e20de7890">tempest-TestServerVolumeAttachScenarioOldVersion-2086663516</nova:project>
Jul 24 17:49:45 user nova-compute[70375]:       </nova:owner>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:49:45 user nova-compute[70375]:       <nova:ports>
Jul 24 17:49:45 user nova-compute[70375]:         <nova:port uuid="fba13bd2-e46f-40e4-bb80-1380bc67687d">
Jul 24 17:49:45 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:49:45 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:45 user nova-compute[70375]:       </nova:ports>
Jul 24 17:49:45 user nova-compute[70375]:     </nova:instance>
Jul 24 17:49:45 user nova-compute[70375]:   </metadata>
Jul 24 17:49:45 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:49:45 user nova-compute[70375]:     <system>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="serial">23c835be-30a5-4353-ac0a-dca4c53e7921</entry>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="uuid">23c835be-30a5-4353-ac0a-dca4c53e7921</entry>
Jul 24 17:49:45 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:49:45 user nova-compute[70375]:     </system>
Jul 24 17:49:45 user nova-compute[70375]:   </sysinfo>
Jul 24 17:49:45 user nova-compute[70375]:   <os>
Jul 24 17:49:45 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:49:45 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:49:45 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:49:45 user nova-compute[70375]:   </os>
Jul 24 17:49:45 user nova-compute[70375]:   <features>
Jul 24 17:49:45 user nova-compute[70375]:     <acpi/>
Jul 24 17:49:45 user nova-compute[70375]:     <apic/>
Jul 24 17:49:45 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:49:45 user nova-compute[70375]:   </features>
Jul 24 17:49:45 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:49:45 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:49:45 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:49:45 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:49:45 user nova-compute[70375]:   </clock>
Jul 24 17:49:45 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:49:45 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:49:45 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:49:45 user nova-compute[70375]:   </cpu>
Jul 24 17:49:45 user nova-compute[70375]:   <devices>
Jul 24 17:49:45 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:49:45 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:49:45 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk"/>
Jul 24 17:49:45 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:49:45 user nova-compute[70375]:     </disk>
Jul 24 17:49:45 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:45 user nova-compute[70375]:       <mac address="fa:16:3e:56:83:5a"/>
Jul 24 17:49:45 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:45 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:45 user nova-compute[70375]:       <target dev="tapfba13bd2-e4"/>
Jul 24 17:49:45 user nova-compute[70375]:     </interface>
Jul 24 17:49:45 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:49:45 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/console.log" append="off"/>
Jul 24 17:49:45 user nova-compute[70375]:     </serial>
Jul 24 17:49:45 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:49:45 user nova-compute[70375]:     <video>
Jul 24 17:49:45 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:45 user nova-compute[70375]:     </video>
Jul 24 17:49:45 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:49:45 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:49:45 user nova-compute[70375]:     </rng>
Jul 24 17:49:45 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:49:45 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:49:45 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:49:45 user nova-compute[70375]:     </memballoon>
Jul 24 17:49:45 user nova-compute[70375]:   </devices>
Jul 24 17:49:45 user nova-compute[70375]: </domain>
Jul 24 17:49:45 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173480',id=12,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+mf4MojBWbx7ndQUqWJiOqyxKTJ0i/MARuffrrP6deCbGyYPBV1Knp2xLIoTZkuys68QPZJQj0tyabqCZLnwJ2Gclu/zA1hjTodLRy2cNwr0KAQ7f7lZXcHSUTZEAmEQ==',key_name='tempest-keypair-545366782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddac964fe7c5486d9a6b009e20de7890',ramdisk_id='',reservation_id='r-3evkzdyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7073c1a99c94606a7056d1ccf31c5cc',uuid=23c835be-30a5-4353-ac0a-dca4c53e7921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converting VIF {"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG os_vif [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfba13bd2-e4, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfba13bd2-e4, col_values=(('external_ids', {'iface-id': 'fba13bd2-e46f-40e4-bb80-1380bc67687d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:83:5a', 'vm-uuid': '23c835be-30a5-4353-ac0a-dca4c53e7921'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:45 user nova-compute[70375]: INFO os_vif [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4')
Jul 24 17:49:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23833626263386135', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833626263386135', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] No VIF found with MAC fa:16:3e:56:83:5a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:49:45 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:49:45 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:49:45 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:49:45 user nova-compute[70375]:   <serial>b75085e2-d522-4114-85d4-4e9eb71a0d74</serial>
Jul 24 17:49:45 user nova-compute[70375]: </disk>
Jul 24 17:49:45 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updated VIF entry in instance network info cache for port fba13bd2-e46f-40e4-bb80-1380bc67687d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updating instance_info_cache with network_info: [{"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd4f4ed0-0b5d-4813-ab5c-b533f5ed85ea req-fa502f84-b279-45fb-84fb-bcf2416615db service nova] Releasing lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:f5:ad:80, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-905e8923-0f65-415a-a029-eaa56fbca1d6 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.146s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] No waiting events found dispatching network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:47 user nova-compute[70375]: WARNING nova.compute.manager [req-c748930a-ed21-4ee4-8ef0-5422d90420eb req-107c5d46-1dca-4658-8bb7-b1629f4ba475 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received unexpected event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d for instance with vm_state building and task_state spawning.
Jul 24 17:49:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] No waiting events found dispatching network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:49 user nova-compute[70375]: WARNING nova.compute.manager [req-4240421a-7f4b-4604-affb-77748fe8c7b5 req-721f381e-281e-4531-b5b2-2e5f9aaacda0 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received unexpected event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d for instance with vm_state building and task_state spawning.
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220989.6617994, 23c835be-30a5-4353-ac0a-dca4c53e7921 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] VM Resumed (Lifecycle Event)
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Instance spawned successfully.
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220989.663991, 23c835be-30a5-4353-ac0a-dca4c53e7921 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] VM Started (Lifecycle Event)
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Took 6.38 seconds to spawn the instance on the hypervisor.
Jul 24 17:49:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:49 user nova-compute[70375]: INFO nova.compute.manager [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Took 7.37 seconds to build instance.
Jul 24 17:49:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc924930-8581-4283-ac5d-d83d493a0b8d tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.602s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:49:50 user nova-compute[70375]: INFO nova.compute.claims [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Claim successful on node user
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:49:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.policy [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edc5d742d0f4dc3ba67f1fad87937ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce4fa18b04c41078f64aa0af0777e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:49:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Creating image(s)
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk 1073741824" returned: 0 in 0.051s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Successfully created port: 3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.175s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Cannot resize image /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'migration_context' on Instance uuid 2d9bc837-e597-42d5-a8c3-826e42621dbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Ensure instance console log exists: /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Successfully updated port: 3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquired lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-changed-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Refreshing instance network info cache due to event network-changed-3289c41e-38ee-49b1-a5fe-91ac1a27947e. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] Acquiring lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updating instance_info_cache with network_info: [{"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Releasing lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Instance network_info: |[{"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] Acquired lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Refreshing network info cache for port 3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Start _get_guest_xml network_info=[{"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:49:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1836582341',display_name='tempest-AttachVolumeNegativeTest-server-1836582341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1836582341',id=13,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhx/xc5v7vPu96/V3riWSEisrTVgThkyOIw4l/CObPDbTOugH6//Lu8uX6vFwBEczV1XuQ8oqGLDRD/IKBqIkLc2Bywo4HiURPE0rARKBqDu7ea/MdK/iT5tIzl+7uFCA==',key_name='tempest-keypair-827887430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-olqqbydq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=2d9bc837-e597-42d5-a8c3-826e42621dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d9bc837-e597-42d5-a8c3-826e42621dbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:49:53 user nova-compute[70375]:   <uuid>2d9bc837-e597-42d5-a8c3-826e42621dbc</uuid>
Jul 24 17:49:53 user nova-compute[70375]:   <name>instance-0000000d</name>
Jul 24 17:49:53 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:49:53 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:49:53 user nova-compute[70375]:   <metadata>
Jul 24 17:49:53 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:49:53 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1836582341</nova:name>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:49:53</nova:creationTime>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:49:53 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:49:53 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:owner>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:user uuid="3edc5d742d0f4dc3ba67f1fad87937ac">tempest-AttachVolumeNegativeTest-777978815-project-member</nova:user>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:project uuid="7ce4fa18b04c41078f64aa0af0777e51">tempest-AttachVolumeNegativeTest-777978815</nova:project>
Jul 24 17:49:53 user nova-compute[70375]:       </nova:owner>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:49:53 user nova-compute[70375]:       <nova:ports>
Jul 24 17:49:53 user nova-compute[70375]:         <nova:port uuid="3289c41e-38ee-49b1-a5fe-91ac1a27947e">
Jul 24 17:49:53 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:49:53 user nova-compute[70375]:         </nova:port>
Jul 24 17:49:53 user nova-compute[70375]:       </nova:ports>
Jul 24 17:49:53 user nova-compute[70375]:     </nova:instance>
Jul 24 17:49:53 user nova-compute[70375]:   </metadata>
Jul 24 17:49:53 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:49:53 user nova-compute[70375]:     <system>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="serial">2d9bc837-e597-42d5-a8c3-826e42621dbc</entry>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="uuid">2d9bc837-e597-42d5-a8c3-826e42621dbc</entry>
Jul 24 17:49:53 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:49:53 user nova-compute[70375]:     </system>
Jul 24 17:49:53 user nova-compute[70375]:   </sysinfo>
Jul 24 17:49:53 user nova-compute[70375]:   <os>
Jul 24 17:49:53 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:49:53 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:49:53 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:49:53 user nova-compute[70375]:   </os>
Jul 24 17:49:53 user nova-compute[70375]:   <features>
Jul 24 17:49:53 user nova-compute[70375]:     <acpi/>
Jul 24 17:49:53 user nova-compute[70375]:     <apic/>
Jul 24 17:49:53 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:49:53 user nova-compute[70375]:   </features>
Jul 24 17:49:53 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:49:53 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:49:53 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:49:53 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:49:53 user nova-compute[70375]:   </clock>
Jul 24 17:49:53 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:49:53 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:49:53 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:49:53 user nova-compute[70375]:   </cpu>
Jul 24 17:49:53 user nova-compute[70375]:   <devices>
Jul 24 17:49:53 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:49:53 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:49:53 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk"/>
Jul 24 17:49:53 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:49:53 user nova-compute[70375]:     </disk>
Jul 24 17:49:53 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:49:53 user nova-compute[70375]:       <mac address="fa:16:3e:ba:41:c8"/>
Jul 24 17:49:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:53 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:49:53 user nova-compute[70375]:       <target dev="tap3289c41e-38"/>
Jul 24 17:49:53 user nova-compute[70375]:     </interface>
Jul 24 17:49:53 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:49:53 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/console.log" append="off"/>
Jul 24 17:49:53 user nova-compute[70375]:     </serial>
Jul 24 17:49:53 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:49:53 user nova-compute[70375]:     <video>
Jul 24 17:49:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:49:53 user nova-compute[70375]:     </video>
Jul 24 17:49:53 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:49:53 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:49:53 user nova-compute[70375]:     </rng>
Jul 24 17:49:53 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:49:53 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:49:53 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:49:53 user nova-compute[70375]:     </memballoon>
Jul 24 17:49:53 user nova-compute[70375]:   </devices>
Jul 24 17:49:53 user nova-compute[70375]: </domain>
Jul 24 17:49:53 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1836582341',display_name='tempest-AttachVolumeNegativeTest-server-1836582341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1836582341',id=13,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhx/xc5v7vPu96/V3riWSEisrTVgThkyOIw4l/CObPDbTOugH6//Lu8uX6vFwBEczV1XuQ8oqGLDRD/IKBqIkLc2Bywo4HiURPE0rARKBqDu7ea/MdK/iT5tIzl+7uFCA==',key_name='tempest-keypair-827887430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-olqqbydq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=2d9bc837-e597-42d5-a8c3-826e42621dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG os_vif [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3289c41e-38, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3289c41e-38, col_values=(('external_ids', {'iface-id': '3289c41e-38ee-49b1-a5fe-91ac1a27947e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:41:c8', 'vm-uuid': '2d9bc837-e597-42d5-a8c3-826e42621dbc'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:53 user nova-compute[70375]: INFO os_vif [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38')
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:49:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:ba:41:c8, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updated VIF entry in instance network info cache for port 3289c41e-38ee-49b1-a5fe-91ac1a27947e. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updating instance_info_cache with network_info: [{"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-89332ac3-e0b6-4ce9-9950-8843390aa777 req-17b0acce-25ac-444e-9cb4-55f6a51d9ea0 service nova] Releasing lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-changed-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Refreshing instance network info cache due to event network-changed-8b4a1f26-60a5-4e34-8427-bff51e93a458. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] Acquiring lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] Acquired lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Refreshing network info cache for port 8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updated VIF entry in instance network info cache for port 8b4a1f26-60a5-4e34-8427-bff51e93a458. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating instance_info_cache with network_info: [{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2339b3bd-c165-468b-be21-d336fa9be7c7 req-1ed993d2-2ed6-4195-a382-ea64ed06222e service nova] Releasing lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] No waiting events found dispatching network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:55 user nova-compute[70375]: WARNING nova.compute.manager [req-bd16f2c3-6d38-4c37-96ca-7e767bc02081 req-d7d4f103-a780-45ee-85b7-403a40489e15 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received unexpected event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e for instance with vm_state building and task_state spawning.
Jul 24 17:49:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] No waiting events found dispatching network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:57 user nova-compute[70375]: WARNING nova.compute.manager [req-ebee7007-8e1d-4157-8bc2-4933cadfc6bc req-56ece03f-4c38-4366-9dad-cdd4f462a182 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received unexpected event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e for instance with vm_state building and task_state spawning.
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220998.028672, 2d9bc837-e597-42d5-a8c3-826e42621dbc => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] VM Resumed (Lifecycle Event)
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Instance spawned successfully.
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690220998.0300417, 2d9bc837-e597-42d5-a8c3-826e42621dbc => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] VM Started (Lifecycle Event)
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Took 6.56 seconds to spawn the instance on the hypervisor.
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Took 7.47 seconds to build instance.
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50491c53-1482-49fb-bb3a-4f349c6a32f5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.616s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:58 user nova-compute[70375]: INFO nova.compute.manager [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Terminating instance
Jul 24 17:49:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-changed-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Refreshing instance network info cache due to event network-changed-986e75bf-5600-44d7-9629-6b543ad130fc. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] Acquiring lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] Acquired lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Refreshing network info cache for port 986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:49:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Instance destroyed successfully.
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lazy-loading 'resources' on Instance uuid 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-823491577',display_name='tempest-VolumesActionsTest-instance-823491577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-823491577',id=6,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:48:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b872f286b614678a434d45336ab0d42',ramdisk_id='',reservation_id='r-lm7yy0hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-160017716',owner_user_name='tempest-VolumesActionsTest-160017716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:48:11Z,user_data=None,user_id='f86f2a560b934073bad9013cd14e52bc',uuid=26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converting VIF {"id": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "address": "fa:16:3e:a8:2e:da", "network": {"id": "d1c95d8e-9f09-47ae-8bd6-363015614977", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1361025355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b872f286b614678a434d45336ab0d42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap310c0730-9b", "ovs_interfaceid": "310c0730-9b68-4fb1-8684-5f97b4b98a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG os_vif [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap310c0730-9b, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:49:59 user nova-compute[70375]: INFO os_vif [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=310c0730-9b68-4fb1-8684-5f97b4b98a02,network=Network(d1c95d8e-9f09-47ae-8bd6-363015614977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap310c0730-9b')
Jul 24 17:49:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Deleting instance files /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b_del
Jul 24 17:49:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Deletion of /opt/stack/data/nova/instances/26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b_del complete
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:59 user nova-compute[70375]: INFO nova.compute.manager [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'flavor' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:59 user nova-compute[70375]: INFO nova.compute.manager [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attaching volume 375202d3-5328-409f-9296-a3f67088b222 to /dev/vdb
Jul 24 17:49:59 user nova-compute[70375]: DEBUG os_brick.utils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c9a7d-856a-4462-8d5a-14ae77c5a979]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc9baf-b3d7-44b3-a75c-ae932c8f6325]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d835da-ed63-494c-bb7f-382c8405dd83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c9c30-ead4-4d17-b5d6-3c13107b2150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-unplugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] No waiting events found dispatching network-vif-unplugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-unplugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Acquiring lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] No waiting events found dispatching network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:49:59 user nova-compute[70375]: WARNING nova.compute.manager [req-0f0b7880-ed68-4cc5-9924-b4196042d7e9 req-4d177d78-01f4-4088-b183-7a446e6813e9 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received unexpected event network-vif-plugged-310c0730-9b68-4fb1-8684-5f97b4b98a02 for instance with vm_state active and task_state deleting.
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:49:59 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:49:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603406c-ead5-4588-9a62-bd531bb709df]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updated VIF entry in instance network info cache for port 986e75bf-5600-44d7-9629-6b543ad130fc. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updating instance_info_cache with network_info: [{"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG os_brick.utils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updating existing volume attachment record: 89ccef9a-37ed-44b9-800a-bee77c9ad708 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-116a7c0d-e686-4a54-8f2c-f8003cdb492c req-e45ad351-b296-4d17-a82f-1a08291cc345 service nova] Releasing lock "refresh_cache-5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:00 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Took 0.65 seconds to deallocate network for instance.
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'flavor' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:00 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Deleted allocations for instance 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a864e23b-d360-4c29-9b5d-215c110a2ed5 tempest-VolumesActionsTest-160017716 tempest-VolumesActionsTest-160017716-project-member] Lock "26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:00 user nova-compute[70375]: INFO nova.compute.manager [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Attaching volume c0e32e38-5247-4310-9ee9-2ea7af1562d2 to /dev/vdb
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.utils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1cbc5c-8a34-416e-86aa-1436335be113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22351a6-103d-4ec9-9621-b70bbb79ad76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a4ceb-2c08-461e-a39f-fa83e1e41660]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40b37f5-7358-45d1-9ee7-79ff9dfefb17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-1b936b32-8f9c-4e83-ad35-e6a4b456f6bc req-e962d90e-666e-4b26-ab30-e8b7635cb091 service nova] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Received event network-vif-deleted-310c0730-9b68-4fb1-8684-5f97b4b98a02 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:01 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:50:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2cc13d-0892-4a0a-bbcd-a00e136ff915]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG os_brick.utils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:01 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating existing volume attachment record: fa56eb5a-8331-4565-a158-7220c5d3ceaa {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:50:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-changed-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Refreshing instance network info cache due to event network-changed-1643285b-2fcb-4065-b5e8-9aa786078d29. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:50:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] Acquiring lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:50:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] Acquired lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:50:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Refreshing network info cache for port 1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:50:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updated VIF entry in instance network info cache for port 1643285b-2fcb-4065-b5e8-9aa786078d29. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:50:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updating instance_info_cache with network_info: [{"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6bd54fd7-5675-47d2-8203-24ece4a57e17 req-819cd53f-0186-4c7f-9843-628127c7828a service nova] Releasing lock "refresh_cache-baeaab3c-ddf0-408f-b148-1afc070a32f6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:50:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'flavor' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:06 user nova-compute[70375]: INFO nova.compute.manager [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Attaching volume 22d60619-81e3-445b-9f51-771d9645976f to /dev/sdc
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.utils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5035df-d55c-4723-b52f-6ac783e3861d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada61834-3acf-4f06-8443-8f4d71067751]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de250b1-8f8c-4c20-a411-f62093e300cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd7aff-0c00-478d-89dc-a528cada513b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:07 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:50:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683a79a-9add-45a5-9bb0-b7d3afc25b5c]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG os_brick.utils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:07 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updating existing volume attachment record: cbcf10dd-b958-44dc-bbe0-c9a7f501e4be {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:50:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.176s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:10 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a725e-8d61-4912-8a53-d5888c47f0ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:50:10 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fda652-edf5-41cd-beaf-cf816d76ecaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222] added
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa73673-f586-4c87-832f-9a0eba8e50ba]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e44105-1446-4753-aae9-ef9e4cb1c116]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIgaweLi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIgaweLi" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b162a177-b991-4ae1-87e8-f26b9930b772]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIgaweLi'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3b86e-285e-4e66-b0a2-8c2b17c52861]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f5d49-fcf1-477b-9166-de30db2eda27]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f8318-6dc7-4ad3-b633-3cd55fce5405]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]
Jul 24 17:50:10 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e6e7c-678e-4ab1-9f9a-273dbe1d4b42]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3401b635-89a7-40fc-bc3b-1f318b1fe202]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39ff117-1efb-4270-8567-8534b485cda6]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:50:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:50:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.546s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] <== connect_volume: return (1549ms) {'type': 'block', 'scsi_wwn': '23832393565346166', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832393565346166', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:50:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'flavor' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:50:12 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:12 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:50:12 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:12 user nova-compute[70375]:   <serial>375202d3-5328-409f-9296-a3f67088b222</serial>
Jul 24 17:50:12 user nova-compute[70375]: </disk>
Jul 24 17:50:12 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:50:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] No VIF found with MAC fa:16:3e:97:c5:b8, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:50:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0809cbf9-f63c-484c-93ee-7d628caceea0 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.869s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.utils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0825f4-82c6-4a7d-88ce-1cdef2f5234a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7439d-42ad-4233-973e-95400e846a67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c9f8f-dc74-456d-8af2-d0b2f5661a50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d1b96-7b35-45af-8fb2-19e54dce74d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:13 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:50:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f60d187-50a5-4188-a73e-674d36e40e09]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:50:13 user nova-compute[70375]: DEBUG os_brick.utils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:14 user nova-compute[70375]: INFO nova.compute.manager [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Swapping volume 375202d3-5328-409f-9296-a3f67088b222 for b5e11488-7154-4293-9e10-2a5843c27eb0
Jul 24 17:50:14 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690220999.2996976, 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:50:14 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] VM Stopped (Lifecycle Event)
Jul 24 17:50:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c8cb3e9-0cad-487e-8068-42782673ebf5 None None] [instance: 26cb38e5-a0a6-448d-a9ad-1ff0a7ad499b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBXTqkyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:14 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:14 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:14 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8189cff-09aa-45fa-9656-c08164599229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:50:14 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4560af2-1724-4657-9ef0-11461d7dd0a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f] added
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d451644a-1df7-49be-aff8-284791cb6bc9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4fbdb-6758-45a3-89b7-c96ae97f9be7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBXTqkyu {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBXTqkyu" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c384d-9c95-42c5-bfdc-39793f64babd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBXTqkyu'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3dfc5-628b-463e-b56d-6e76881051ab]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3e4722-3e31-4d15-af14-a435187f79fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9770a-1b78-418f-bf25-5552d478e0df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260]
Jul 24 17:50:14 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc8bef-0e7c-457e-ac06-6f5b1f4a7845]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRoVkfIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:14 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2ea67d-9aba-492a-a173-fa67cb7e29f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:14 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94112514-200a-4627-a560-7f9215ce648f]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:50:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBXTqkyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23264343463306336', 'path': '/dev/sdg'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264343463306336', 'path': '/dev/sdg'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.046s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:15 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:15 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'flavor' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd085e-2ea0-4b74-af79-bfbf584fe415]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:50:15 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:50:15 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:15 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 17:50:15 user nova-compute[70375]:   <target dev="sdc" bus="scsi"/>
Jul 24 17:50:15 user nova-compute[70375]:   <serial>22d60619-81e3-445b-9f51-771d9645976f</serial>
Jul 24 17:50:15 user nova-compute[70375]:   <address type="drive" controller="0" unit="2"/>
Jul 24 17:50:15 user nova-compute[70375]: </disk>
Jul 24 17:50:15 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797cef4-2eab-481d-ba79-28ae5f4b3c02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2] added
Jul 24 17:50:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[41893672-ba95-49bf-8b30-cec812f3b68a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c72453d-1622-4aad-9ca1-92ca0a30dc16]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRoVkfIU {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRoVkfIU" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee87b4-44fa-4cdb-9f79-99bb556159bc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRoVkfIU'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e1ead-c344-4d51-87bd-1d4a7b86aaeb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1b6b3-ed00-4dff-b1af-89ce2b42b753]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[88efe75c-c998-4fe9-9c44-eb042084af47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260]
Jul 24 17:50:16 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d259807-581a-42b3-a3de-e3ac739bbcbc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc882d-1810-4680-94e0-9bb19174eec3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:16 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf9c84-44b6-4ac1-8ed7-6dbccbd5f013]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRoVkfIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No BDM found with device name sda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] No VIF found with MAC fa:16:3e:c9:3c:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:50:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c04527c9-ab4c-4c59-ad3c-7f1a834d10d1 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.821s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] <== connect_volume: return (2423ms) {'type': 'block', 'scsi_wwn': '26261303736666632', 'path': '/dev/sdh'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261303736666632', 'path': '/dev/sdh'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'flavor' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:50:17 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:17 user nova-compute[70375]:   <source dev="/dev/sdh"/>
Jul 24 17:50:17 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:17 user nova-compute[70375]:   <serial>c0e32e38-5247-4310-9ee9-2ea7af1562d2</serial>
Jul 24 17:50:17 user nova-compute[70375]: </disk>
Jul 24 17:50:17 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No VIF found with MAC fa:16:3e:08:f8:2f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53f09bfd-1905-490e-a0b2-21e5eac0f440 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.831s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:17 user nova-compute[70375]: INFO nova.compute.manager [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Detaching volume 22d60619-81e3-445b-9f51-771d9645976f
Jul 24 17:50:17 user nova-compute[70375]: INFO nova.virt.block_device [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Attempting to driver detach volume 22d60619-81e3-445b-9f51-771d9645976f from mountpoint /dev/sdc
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Attempting to detach device sdc from instance baeaab3c-ddf0-408f-b148-1afc070a32f6 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:17 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:17 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 17:50:17 user nova-compute[70375]:   <target dev="sdc" bus="scsi"/>
Jul 24 17:50:17 user nova-compute[70375]:   <serial>22d60619-81e3-445b-9f51-771d9645976f</serial>
Jul 24 17:50:17 user nova-compute[70375]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 17:50:17 user nova-compute[70375]: </disk>
Jul 24 17:50:17 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Successfully detached device sdc from instance baeaab3c-ddf0-408f-b148-1afc070a32f6 from the persistent domain config.
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance baeaab3c-ddf0-408f-b148-1afc070a32f6 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:50:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:17 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:17 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 17:50:17 user nova-compute[70375]:   <target dev="sdc" bus="scsi"/>
Jul 24 17:50:17 user nova-compute[70375]:   <serial>22d60619-81e3-445b-9f51-771d9645976f</serial>
Jul 24 17:50:17 user nova-compute[70375]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 17:50:17 user nova-compute[70375]: </disk>
Jul 24 17:50:17 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221018.2804813, baeaab3c-ddf0-408f-b148-1afc070a32f6 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:50:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Successfully detached device sdc from instance baeaab3c-ddf0-408f-b148-1afc070a32f6 from the live domain config.
Jul 24 17:50:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBXTqkyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:18 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[93260e36-da14-4b5e-9719-32227236ee5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:18 user nova-compute[70375]: No targets found.
Jul 24 17:50:18 user nova-compute[70375]: iSNS:
Jul 24 17:50:18 user nova-compute[70375]: No targets found.
Jul 24 17:50:18 user nova-compute[70375]: STATIC:
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2
Jul 24 17:50:18 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:18 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:18 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:18 user nova-compute[70375]: No targets found.
Jul 24 17:50:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:18 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:18 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[360c36bc-bc1d-4b8a-9428-63325e6a652d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4c5ac-2394-48b0-88f3-e0722584bd9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f (non-flash)
Jul 24 17:50:18 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650283910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f'): ({'sdg'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Removing single pathed devices sdg {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc15f1-6c06-45ce-b742-7b6b43611d6d]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe7e17-4bb4-4784-8409-14ff83fdd8c8]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Flushing IO for device /dev/sdg {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d28a745-b8d9-4069-ac5a-0d9bc48f2c8c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4834fce0-f325-4d62-bcda-a925e7f3437c]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e0aa5-f56c-488e-a3f1-a47c00191062]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dab0840-c8d1-4380-8c56-f1079721f8dc]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260]
Jul 24 17:50:18 user nova-compute[70375]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d60619-81e3-445b-9f51-771d9645976f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1309eb-247e-4c93-ab8a-5ca94f74d3ba]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] <== disconnect_volume: return (333ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:18 user nova-compute[70375]: INFO nova.compute.manager [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Detaching volume c0e32e38-5247-4310-9ee9-2ea7af1562d2
Jul 24 17:50:19 user nova-compute[70375]: INFO nova.virt.block_device [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Attempting to driver detach volume c0e32e38-5247-4310-9ee9-2ea7af1562d2 from mountpoint /dev/vdb
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Attempting to detach device vdb from instance 06592a39-04a0-4e73-bb76-546a29fedab3 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:19 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:19 user nova-compute[70375]:   <source dev="/dev/sdh"/>
Jul 24 17:50:19 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:19 user nova-compute[70375]:   <serial>c0e32e38-5247-4310-9ee9-2ea7af1562d2</serial>
Jul 24 17:50:19 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:50:19 user nova-compute[70375]: </disk>
Jul 24 17:50:19 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:19 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully detached device vdb from instance 06592a39-04a0-4e73-bb76-546a29fedab3 from the persistent domain config.
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06592a39-04a0-4e73-bb76-546a29fedab3 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:19 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:19 user nova-compute[70375]:   <source dev="/dev/sdh"/>
Jul 24 17:50:19 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:19 user nova-compute[70375]:   <serial>c0e32e38-5247-4310-9ee9-2ea7af1562d2</serial>
Jul 24 17:50:19 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:50:19 user nova-compute[70375]: </disk>
Jul 24 17:50:19 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'flavor' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dcec8ded-e51a-4538-a925-2011ceb8c72d tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221019.5583653, 06592a39-04a0-4e73-bb76-546a29fedab3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:50:19 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully detached device vdb from instance 06592a39-04a0-4e73-bb76-546a29fedab3 from the live domain config.
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRoVkfIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:19 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6798be-19f6-42e2-84a4-3b2cb263bbc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:19 user nova-compute[70375]: No targets found.
Jul 24 17:50:19 user nova-compute[70375]: iSNS:
Jul 24 17:50:19 user nova-compute[70375]: No targets found.
Jul 24 17:50:19 user nova-compute[70375]: STATIC:
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2
Jul 24 17:50:19 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:19 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:19 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:19 user nova-compute[70375]: No targets found.
Jul 24 17:50:19 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:19 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:19 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deaed01-12ad-4d60-8a3b-7789d4fc825e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b04ad6-8e8e-4df7-ab0a-f81b50d8c568]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 (non-flash)
Jul 24 17:50:19 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2'): ({'sdh'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Removing single pathed devices sdh {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840d459-716d-48a8-a95f-8b8e458164d7]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[141025fc-176d-4cda-9525-5103b09d41ff]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Flushing IO for device /dev/sdh {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9dd19a-132a-4c9c-9dbf-870d4a4ae9f1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b8d6f-137f-479a-b71a-de80f4e526ff]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] SCSI volumes sdh have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[89579854-4dca-415f-a76b-2547318e4aa0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d24788-eb82-44be-964b-4a7662a8f48d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260]
Jul 24 17:50:19 user nova-compute[70375]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:19 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e32e38-5247-4310-9ee9-2ea7af1562d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ca531-8c8c-473b-a1e2-6e00a8a7d5a6]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] <== disconnect_volume: return (333ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:20 user nova-compute[70375]: INFO nova.compute.manager [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Terminating instance
Jul 24 17:50:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'flavor' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70f871d8-bfec-45ed-9f1a-66585910c9cf tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-unplugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] No waiting events found dispatching network-vif-unplugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-9a06c38c-f5f4-4534-a5da-1ac898b499cf req-71161735-c939-4ed2-81b5-8a2c0c10310a service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-unplugged-1643285b-2fcb-4065-b5e8-9aa786078d29 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Instance destroyed successfully.
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lazy-loading 'resources' on Instance uuid baeaab3c-ddf0-408f-b148-1afc070a32f6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-846125168',display_name='tempest-AttachSCSIVolumeTestJSON-server-846125168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-846125168',id=9,image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwcXYsB7TE6W+EukYrqvRTiSN/LSavI0nw965W/w59Wnt/hnzV0W/ARfXtGaNy3bgFX5EClANX3eHT2W9l+lQ1TDUpZ3NbLPwFNms8PCNbJUDhl/8+5+h80gGaL8bFtwQ==',key_name='tempest-keypair-329978910',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4afdbf439e34a50b8f4f4e150c53135',ramdisk_id='',reservation_id='r-jfi1n9y4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55661654-b7ea-4b91-8ee6-d1aded0d1195',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1154458008',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1154458008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d183dba1af14851b3a6b56cc3ed42c2',uuid=baeaab3c-ddf0-408f-b148-1afc070a32f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converting VIF {"id": "1643285b-2fcb-4065-b5e8-9aa786078d29", "address": "fa:16:3e:c9:3c:7f", "network": {"id": "a62cc5fe-f972-43d0-aa6a-ac89ba943822", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1328996371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4afdbf439e34a50b8f4f4e150c53135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1643285b-2f", "ovs_interfaceid": "1643285b-2fcb-4065-b5e8-9aa786078d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG os_vif [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1643285b-2f, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:21 user nova-compute[70375]: INFO os_vif [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3c:7f,bridge_name='br-int',has_traffic_filtering=True,id=1643285b-2fcb-4065-b5e8-9aa786078d29,network=Network(a62cc5fe-f972-43d0-aa6a-ac89ba943822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1643285b-2f')
Jul 24 17:50:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Deleting instance files /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6_del
Jul 24 17:50:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Deletion of /opt/stack/data/nova/instances/baeaab3c-ddf0-408f-b148-1afc070a32f6_del complete
Jul 24 17:50:21 user nova-compute[70375]: INFO nova.compute.manager [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 17:50:21 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:50:21 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0', 'serial': 'b5e11488-7154-4293-9e10-2a5843c27eb0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': '375202d3-5328-409f-9296-a3f67088b222', 'serial'} {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:22 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[481297e8-e0a9-48e1-b770-581214c153a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:50:22 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c077c6fa-afe6-46de-add5-fb44312d2179]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0] added
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5caeb-135c-40c4-a37b-cd6ffaca5005]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa76926-2281-4e27-9858-464a9d63e262]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuNzyiOF {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuNzyiOF" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc0d978-bbf6-4660-ad3c-cf52c0086a67]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuNzyiOF'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d4884-9687-44e8-a03b-31354c86b385]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52465618-f6e5-4403-98e6-2048b9f2129b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab736b3-795b-45c6-8401-5fcd4d982c79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260]
Jul 24 17:50:22 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd94e40b-ceea-4d13-93a0-0d813c9d0640]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d5303-6766-49fc-b96e-55bea25b372c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f8ac4-6976-4d05-b488-88fcd149aaeb]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:50:22 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Took 0.95 seconds to deallocate network for instance.
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-351537a1-ee45-4268-ac98-788525e86d00 req-908a8b0c-5774-47af-a2c4-566177c19003 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-deleted-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] Acquiring lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] No waiting events found dispatching network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:22 user nova-compute[70375]: WARNING nova.compute.manager [req-e187cd55-383b-475c-8335-4100e956ad3c req-4755b7a1-a72e-4607-addb-1656bc7788b0 service nova] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Received unexpected event network-vif-plugged-1643285b-2fcb-4065-b5e8-9aa786078d29 for instance with vm_state deleted and task_state None.
Jul 24 17:50:22 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:23 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Deleted allocations for instance baeaab3c-ddf0-408f-b148-1afc070a32f6
Jul 24 17:50:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5faa0c28-6260-4497-b264-17f751fa9ae6 tempest-AttachSCSIVolumeTestJSON-1154458008 tempest-AttachSCSIVolumeTestJSON-1154458008-project-member] Lock "baeaab3c-ddf0-408f-b148-1afc070a32f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.660s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23437383064346131', 'path': '/dev/sdg'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383064346131', 'path': '/dev/sdg'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG nova.objects.instance [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lazy-loading 'flavor' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 627048448 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 932184064 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:27 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0565297-7f8d-40fb-a90e-a90771a2d85f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:27 user nova-compute[70375]: No targets found.
Jul 24 17:50:27 user nova-compute[70375]: iSNS:
Jul 24 17:50:27 user nova-compute[70375]: No targets found.
Jul 24 17:50:27 user nova-compute[70375]: STATIC:
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:27 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:27 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:27 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:27 user nova-compute[70375]: No targets found.
Jul 24 17:50:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:27 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:27 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[99effee0-7184-4787-8a16-5e1313635b1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab99556-6890-460f-85a3-e5aa711f6e50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650282200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac7d82-0d89-4ca2-8329-8471db562b64]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb68f2-8da1-40d8-857a-ad3064455f29]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d883cd-9e81-4076-838c-93a703d2c2c5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c47ec59-a82e-47c8-9441-bfdde315be74]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52530d52-b22c-4201-821d-6ae8a8b9cab7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f50cc3f-3bcd-4eb4-a22a-72ff6999770e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]
Jul 24 17:50:27 user nova-compute[70375]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5bc92-f0b3-42f8-b83f-93f56944d9b0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== disconnect_volume: return (348ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0', 'serial'} {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 17:50:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: removing Cinder connection for volume 375202d3-5328-409f-9296-a3f67088b222 {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 17:50:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: Updating volume 375202d3-5328-409f-9296-a3f67088b222 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "RuNzyiOF", "auth_password": "lUdzpqiRJgP1Gv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "b5e11488-7154-4293-9e10-2a5843c27eb0"}, "status": "reserved", "instance": "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4", "attached_at": "", "detached_at": "", "volume_id": "b5e11488-7154-4293-9e10-2a5843c27eb0", "serial": "b5e11488-7154-4293-9e10-2a5843c27eb0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0', 'no_device': None, 'attachment_id': 'b024fbb9-9712-477b-b024-5ac6c1a6c417'} {{(pid=70375) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 17:50:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-090dbbe7-8252-4711-b0f5-143c50b72cb4 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.075s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.utils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee5d9c-5e48-4565-a645-ba7711dedf9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec71420-a59b-4f8f-a354-c06bb1db1991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b49afd-f573-4666-8ab3-dec3c8681c06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec575d3f-cf28-4779-a8e3-da2b696e33a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:50:29 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:50:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bf3b6-caf7-40cf-acea-d69373eecfe1]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:50:29 user nova-compute[70375]: DEBUG os_brick.utils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:29 user nova-compute[70375]: INFO nova.compute.manager [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Swapping volume b5e11488-7154-4293-9e10-2a5843c27eb0 for 375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221021.3336804, baeaab3c-ddf0-408f-b148-1afc070a32f6 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:50:36 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] VM Stopped (Lifecycle Event)
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-08e9ed88-c792-4196-82ed-2a76383ac07f None None] [instance: baeaab3c-ddf0-408f-b148-1afc070a32f6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:50:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': '375202d3-5328-409f-9296-a3f67088b222', 'serial': '375202d3-5328-409f-9296-a3f67088b222'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0'}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0', 'serial'} {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:37 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:37 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:37 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e7523-36bc-4e53-a160-e4edca3170ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:50:37 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[12785cfb-a557-4599-8f75-75f7020a4b75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222] added
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99bae6-db06-4dcc-ac71-215c786e6b8f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18a29b-75e8-40f6-abec-c420b8295272]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIgaweLi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NIgaweLi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f8dcd2-8e30-4796-9cc4-7ac3a3d8bd9d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NIgaweLi'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e12bcb-68cf-4e1d-9ba2-77659ffb7b74]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16ca4c-149c-4f01-89df-43592100dbc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7fae4-6b71-4a95-af65-daf64fb99fe3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]
Jul 24 17:50:37 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f296a45e-f053-4289-b148-130f1e4c6034]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[400f98c9-e957-4fd2-812a-46a40d0b2ed8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5a26f-3ecf-446e-a502-509cf96ff1a3]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:50:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23832393565346166', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832393565346166', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lazy-loading 'flavor' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 128974848 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:41 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:50:41 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7127MB free_disk=24.48565673828125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a32f2c47-1d35-4436-9da4-7c94de7ed79c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 823fa668-f964-4574-aeec-009ceb0cdc40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 23c835be-30a5-4353-ac0a-dca4c53e7921 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 2d9bc837-e597-42d5-a8c3-826e42621dbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 752877568 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:50:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 927989760 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNzyiOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b5e11488-7154-4293-9e10-2a5843c27eb0'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:42 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c194cd36-d5b6-456b-99fd-0a3503c3dcb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:42 user nova-compute[70375]: No targets found.
Jul 24 17:50:42 user nova-compute[70375]: iSNS:
Jul 24 17:50:42 user nova-compute[70375]: No targets found.
Jul 24 17:50:42 user nova-compute[70375]: STATIC:
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:42 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:42 user nova-compute[70375]: No targets found.
Jul 24 17:50:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:42 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:42 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2ed8a-00d8-42ad-bc32-d2fa3399f91e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[639d949a-6d7c-4a5e-9bde-a4f59004bb1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0'): ({'sdg'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Removing single pathed devices sdg {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b71b684-0305-4a26-b5e4-c10db6b1c3d6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17f535-021c-4aef-a648-e0e8add50c94]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Flushing IO for device /dev/sdg {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[70670db6-f543-424f-8423-02adf6d00444]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0452e936-76a8-471d-9944-8f556605918f]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0bc48f-42bd-4356-99a9-8df3970627c1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd170384-60d2-4dc8-8c00-e08d8ef0864c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260]
Jul 24 17:50:43 user nova-compute[70375]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e11488-7154-4293-9e10-2a5843c27eb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[566715f7-0f74-4610-b94d-baf38c2cbaa0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] <== disconnect_volume: return (345ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4', 'attached_at': '', 'detached_at': '', 'volume_id': '375202d3-5328-409f-9296-a3f67088b222', 'serial'} {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: removing Cinder connection for volume b5e11488-7154-4293-9e10-2a5843c27eb0 {{(pid=70375) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-changed-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing instance network info cache due to event network-changed-3bd8a854-b8bd-4887-b966-6a6218521b93. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] Acquiring lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] Acquired lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Refreshing network info cache for port 3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] swap_volume: Updating volume b5e11488-7154-4293-9e10-2a5843c27eb0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NIgaweLi", "auth_password": "zbxUKT153wkrdu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "375202d3-5328-409f-9296-a3f67088b222"}, "status": "reserved", "instance": "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4", "attached_at": "", "detached_at": "", "volume_id": "375202d3-5328-409f-9296-a3f67088b222", "serial": "375202d3-5328-409f-9296-a3f67088b222"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '375202d3-5328-409f-9296-a3f67088b222', 'no_device': None, 'attachment_id': 'ab009dfa-8767-4dc3-a77f-cff5dc0629ed'} {{(pid=70375) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 17:50:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d25d0d1a-e5fb-4e01-aea2-13202d533247 tempest-TestVolumeSwap-1080683356 tempest-TestVolumeSwap-1080683356-project-admin] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.428s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updated VIF entry in instance network info cache for port 3bd8a854-b8bd-4887-b966-6a6218521b93. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:50:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c6668d1-2b5e-40c8-90f9-fbc86318a1ab req-67e37252-abe6-4750-996f-dffd1e6b31c3 service nova] Releasing lock "refresh_cache-4ad9c9c1-db8a-4718-98bf-efc13341efe2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:45 user nova-compute[70375]: INFO nova.compute.manager [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Detaching volume 375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:45 user nova-compute[70375]: INFO nova.virt.block_device [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Attempting to driver detach volume 375202d3-5328-409f-9296-a3f67088b222 from mountpoint /dev/vdb
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Attempting to detach device vdb from instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:45 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:45 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:50:45 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:45 user nova-compute[70375]:   <serial>375202d3-5328-409f-9296-a3f67088b222</serial>
Jul 24 17:50:45 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:50:45 user nova-compute[70375]: </disk>
Jul 24 17:50:45 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Successfully detached device vdb from instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 from the persistent domain config.
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:50:45 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:50:45 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:50:45 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:50:45 user nova-compute[70375]:   <serial>375202d3-5328-409f-9296-a3f67088b222</serial>
Jul 24 17:50:45 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:50:45 user nova-compute[70375]: </disk>
Jul 24 17:50:45 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221045.8621058, 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:50:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Successfully detached device vdb from instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 from the live domain config.
Jul 24 17:50:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NIgaweLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '375202d3-5328-409f-9296-a3f67088b222'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:45 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd86381d-9756-41ff-bb81-b86fb8fe2c9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:45 user nova-compute[70375]: No targets found.
Jul 24 17:50:45 user nova-compute[70375]: iSNS:
Jul 24 17:50:45 user nova-compute[70375]: No targets found.
Jul 24 17:50:45 user nova-compute[70375]: STATIC:
Jul 24 17:50:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222
Jul 24 17:50:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:45 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:45 user nova-compute[70375]: No targets found.
Jul 24 17:50:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:45 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:45 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[414dd29d-e0a8-4db0-b50a-73eb3a04b487]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[174b7aaf-40b6-4edd-aa7d-fae02221d5c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe648318820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257f443-22a2-4f3f-a8dd-c61ab36d4a26]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:46 user nova-compute[70375]: INFO nova.compute.manager [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Terminating instance
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae06bef9-cdc2-488e-a5c6-dca4cf3087ac]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc025b5-57c6-438d-8185-6a6fca0e70b5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e77476-0a3d-461c-a0dd-5de86661e102]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4ec3c-b69f-4613-b514-e049131de2de]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27981e29-6d3e-4f78-bc9b-6791ca7cc875]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260]
Jul 24 17:50:46 user nova-compute[70375]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375202d3-5328-409f-9296-a3f67088b222 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8349317-0930-4570-ad3b-311db6b8bbcb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] <== disconnect_volume: return (412ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-6708905f-956c-46f3-83ef-effc6f948ff8 req-cf3ee13e-1a3f-49a1-8300-e0a841d2b97a service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-3bd8a854-b8bd-4887-b966-6a6218521b93 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-e2593c1b-ddef-4291-ab57-95b18e7fbe57 req-2080e47a-2db4-40af-91ff-cdae77c52bcd service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Instance destroyed successfully.
Jul 24 17:50:47 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lazy-loading 'resources' on Instance uuid 4ad9c9c1-db8a-4718-98bf-efc13341efe2 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bd8a854-b8, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:94:1f,bridge_name='br-int',has_traffic_filtering=True,id=3bd8a854-b8bd-4887-b966-6a6218521b93,network=Network(3af08e36-54e5-4f9f-84b2-c611e4f8f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd8a854-b8')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape65168c4-db, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fb:75,bridge_name='br-int',has_traffic_filtering=True,id=e65168c4-db5e-4041-aa1d-f64f8ff3beb0,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape65168c4-db')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0244096a-61, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:29,bridge_name='br-int',has_traffic_filtering=True,id=0244096a-6108-4654-b248-11efca5e5c96,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0244096a-61')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc14ca673-d1, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ca673-d1')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "52d09f27-1319-4c49-8720-74ad6d4551cf", "address": "fa:16:3e:33:96:b9", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d09f27-13", "ovs_interfaceid": "52d09f27-1319-4c49-8720-74ad6d4551cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52d09f27-13, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'flavor' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:96:b9,bridge_name='br-int',has_traffic_filtering=True,id=52d09f27-1319-4c49-8720-74ad6d4551cf,network=Network(d009b994-9363-43c5-90a4-53bdfff21955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d09f27-13')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8644f057-dd, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:97:b5,bridge_name='br-int',has_traffic_filtering=True,id=8644f057-dd43-48a5-9da7-1ea5da6b61c5,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8644f057-dd')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2135240199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2135240199',id=10,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKyk97ZQdTPZFQn2/cXzdQ7XRcXSUmHkgYOp/XX7z0Bjy6oGyvtxKWb8AZVeUWBnd2O571hArwJdT9XOMY0xtyoKz1LOayNRs0Losi73Ej2NKjfiuK79I5WBgcgDlg1Qw==',key_name='tempest-keypair-514304954',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa669d08f14f415b945c7bd94d10fc0a',ramdisk_id='',reservation_id='r-pc31znfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-623693073',owner_user_name='tempest-TaggedBootDevicesTest_v242-623693073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df7f047b82446c887ac315c2dd9661d',uuid=4ad9c9c1-db8a-4718-98bf-efc13341efe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converting VIF {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb995f09-e7, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2bac9729-9060-4173-a400-4ccf6d37130b tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.190s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:48 user nova-compute[70375]: INFO os_vif [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:24:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd,network=Network(1415cc01-b10c-455d-a8a0-d92115395d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb995f09-e7')
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYSFvMNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[303d26c9-425e-4fa5-8a32-08c2ca295a03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]: iSNS:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]: STATIC:
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:48 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:48 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f197f154-b005-4771-a2b0-a66d8953de54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c349d3c-c9ad-4f30-bdfd-ebedd7d23529]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0f028e-8084-421e-adef-720258eff129]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13653924-75ad-42d9-bf74-82e3e542159b]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef5b50-bfbc-4479-a6f6-9f669e90defc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d90ba-bc87-4f85-a6e4-a9270c97cdec]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-3bd8a854-b8bd-4887-b966-6a6218521b93 for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-52d09f27-1319-4c49-8720-74ad6d4551cf for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-52d09f27-1319-4c49-8720-74ad6d4551cf for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-8644f057-dd43-48a5-9da7-1ea5da6b61c5 for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-5907ed28-6d5b-4a84-932b-f230762fa5db req-5a81b919-f8cd-4186-911f-37defdfac8ab service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7fd5a2-0fb0-4aa9-9422-9642eb825c3d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b762e7-9edd-40f7-a0ab-574b389b5695]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260]
Jul 24 17:50:48 user nova-compute[70375]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4952d2cf-4c45-4146-bb39-8e12c82b14e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[80240ae3-380e-4003-9e90-efa275314da7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== disconnect_volume: return (336ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwTUmFqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762f431-d5a3-4424-b9a8-6a85d5731e21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]: iSNS:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]: STATIC:
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:48 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:48 user nova-compute[70375]: No targets found.
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:48 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:48 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-e65168c4-db5e-4041-aa1d-f64f8ff3beb0 for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-unplugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-unplugged-0244096a-6108-4654-b248-11efca5e5c96 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:48 user nova-compute[70375]: WARNING nova.compute.manager [req-c1f1f835-e918-457e-8d20-656df995fa2f req-52addba2-fffe-4290-8165-e0cc3878daae service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-0244096a-6108-4654-b248-11efca5e5c96 for instance with vm_state active and task_state deleting.
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cccea4-ef7e-4001-8aa8-499cdd08b2ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5c774b-b291-4cfb-af8e-eecce4ff21f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b923d7-491d-4e80-8a25-de713ae0e60b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f838c-14dd-4b1e-8eef-bd651a7f7cca]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe1085-a623-499f-a0cf-e83cd361c622]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81051ce-8f2d-4c5a-a75c-9540cc5436fe]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[858adb34-37f2-4aeb-8e76-09dac5bb6127]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a706c976-986d-446b-a575-f36b6e4a44c8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260]
Jul 24 17:50:48 user nova-compute[70375]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba776a95-7068-4f8c-a5c1-634aa40416d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca25de-ec31-429a-ae6d-14cc5bc2cfb3]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== disconnect_volume: return (311ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzMLGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:50:49 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1bef24-7ec7-4fca-a022-4581336dfcf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:50:49 user nova-compute[70375]: No targets found.
Jul 24 17:50:49 user nova-compute[70375]: iSNS:
Jul 24 17:50:49 user nova-compute[70375]: No targets found.
Jul 24 17:50:49 user nova-compute[70375]: STATIC:
Jul 24 17:50:49 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:50:49 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:49 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:49 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e
Jul 24 17:50:49 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:50:49 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:50:49 user nova-compute[70375]: FIRMWARE:
Jul 24 17:50:49 user nova-compute[70375]: No targets found.
Jul 24 17:50:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:50:49 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:50:49 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f30c9aa-6a92-4714-b9f4-1005052821c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71992f-e21f-41e7-a99e-e3c51f1eda5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:49 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e (non-flash)
Jul 24 17:50:49 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:50:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6408b6-e389-4c0f-b2d5-898d55816078]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab69ced-fb88-4b32-8d54-9d7f80019f48]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5bdc6-9a72-4638-b718-6306c2e34a87]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbcb1eb-7af8-4929-9a50-e4c2380f966c]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[87789ea2-3129-422c-8a23-1dbacbf1e582]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f38cf-f186-4b42-874f-a72c725bc6a7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260]
Jul 24 17:50:49 user nova-compute[70375]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e, portal: 172.16.0.220,3260] successful.
Jul 24 17:50:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e825b49c-a556-46ef-82e2-00b900f0623e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb71f211-3cf6-4f38-871c-4f1a4469a4b9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] <== disconnect_volume: return (316ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:50:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Deleting instance files /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2_del
Jul 24 17:50:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Deletion of /opt/stack/data/nova/instances/4ad9c9c1-db8a-4718-98bf-efc13341efe2_del complete
Jul 24 17:50:49 user nova-compute[70375]: INFO nova.compute.manager [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Took 3.50 seconds to destroy the instance on the hypervisor.
Jul 24 17:50:49 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:50:49 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] Acquiring lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] No waiting events found dispatching network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:50:50 user nova-compute[70375]: WARNING nova.compute.manager [req-02c38478-3c51-429e-9e82-2c3627163235 req-7058c137-be0c-4eb5-a3a6-3005b77e5ba5 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received unexpected event network-vif-plugged-eb995f09-e7f4-4fe6-84c5-a4659a0666cd for instance with vm_state active and task_state deleting.
Jul 24 17:50:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7ea2a14-cfcb-450a-8264-1f03142dced1 req-57895b31-d217-40eb-ac23-c3ac1c5bb929 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-deleted-52d09f27-1319-4c49-8720-74ad6d4551cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:51 user nova-compute[70375]: INFO nova.compute.manager [req-e7ea2a14-cfcb-450a-8264-1f03142dced1 req-57895b31-d217-40eb-ac23-c3ac1c5bb929 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Neutron deleted interface 52d09f27-1319-4c49-8720-74ad6d4551cf; detaching it from the instance and deleting it from the info cache
Jul 24 17:50:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-e7ea2a14-cfcb-450a-8264-1f03142dced1 req-57895b31-d217-40eb-ac23-c3ac1c5bb929 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "3bd8a854-b8bd-4887-b966-6a6218521b93", "address": "fa:16:3e:61:94:1f", "network": {"id": "3af08e36-54e5-4f9f-84b2-c611e4f8f88e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-215837654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd8a854-b8", "ovs_interfaceid": "3bd8a854-b8bd-4887-b966-6a6218521b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7ea2a14-cfcb-450a-8264-1f03142dced1 req-57895b31-d217-40eb-ac23-c3ac1c5bb929 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Detach interface failed, port_id=52d09f27-1319-4c49-8720-74ad6d4551cf, reason: Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-deleted-3bd8a854-b8bd-4887-b966-6a6218521b93 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:53 user nova-compute[70375]: INFO nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Neutron deleted interface 3bd8a854-b8bd-4887-b966-6a6218521b93; detaching it from the instance and deleting it from the info cache
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "address": "fa:16:3e:52:97:b5", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8644f057-dd", "ovs_interfaceid": "8644f057-dd43-48a5-9da7-1ea5da6b61c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:53 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Took 3.87 seconds to deallocate network for instance.
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Detach interface failed, port_id=3bd8a854-b8bd-4887-b966-6a6218521b93, reason: Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-deleted-8644f057-dd43-48a5-9da7-1ea5da6b61c5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:53 user nova-compute[70375]: INFO nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Neutron deleted interface 8644f057-dd43-48a5-9da7-1ea5da6b61c5; detaching it from the instance and deleting it from the info cache
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "address": "fa:16:3e:1c:1c:6e", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ca673-d1", "ovs_interfaceid": "c14ca673-d1a7-45fb-872f-e9de56e9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Detach interface failed, port_id=8644f057-dd43-48a5-9da7-1ea5da6b61c5, reason: Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-deleted-c14ca673-d1a7-45fb-872f-e9de56e9c7e5 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:53 user nova-compute[70375]: INFO nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Neutron deleted interface c14ca673-d1a7-45fb-872f-e9de56e9c7e5; detaching it from the instance and deleting it from the info cache
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "address": "fa:16:3e:2b:24:ee", "network": {"id": "1415cc01-b10c-455d-a8a0-d92115395d49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1928184277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb995f09-e7", "ovs_interfaceid": "eb995f09-e7f4-4fe6-84c5-a4659a0666cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7a77028-6919-41ae-ba43-df2a322d1717 req-40d6de77-828d-4dc0-8ab6-16413c4ba288 service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Detach interface failed, port_id=c14ca673-d1a7-45fb-872f-e9de56e9c7e5, reason: Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:50:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-4a94a6db-31a6-49d0-b513-255555f7d763 req-b9fad685-98a8-43df-9052-7d2ba484d9cf service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Received event network-vif-deleted-eb995f09-e7f4-4fe6-84c5-a4659a0666cd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:50:55 user nova-compute[70375]: INFO nova.compute.manager [req-4a94a6db-31a6-49d0-b513-255555f7d763 req-b9fad685-98a8-43df-9052-7d2ba484d9cf service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Neutron deleted interface eb995f09-e7f4-4fe6-84c5-a4659a0666cd; detaching it from the instance and deleting it from the info cache
Jul 24 17:50:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-4a94a6db-31a6-49d0-b513-255555f7d763 req-b9fad685-98a8-43df-9052-7d2ba484d9cf service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Updating instance_info_cache with network_info: [{"id": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "address": "fa:16:3e:c5:fb:75", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65168c4-db", "ovs_interfaceid": "e65168c4-db5e-4041-aa1d-f64f8ff3beb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0244096a-6108-4654-b248-11efca5e5c96", "address": "fa:16:3e:82:bc:29", "network": {"id": "d009b994-9363-43c5-90a4-53bdfff21955", "bridge": "br-int", "label": "tempest-device-tagging-net1-1537898359", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa669d08f14f415b945c7bd94d10fc0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0244096a-61", "ovs_interfaceid": "0244096a-6108-4654-b248-11efca5e5c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:50:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-4a94a6db-31a6-49d0-b513-255555f7d763 req-b9fad685-98a8-43df-9052-7d2ba484d9cf service nova] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Detach interface failed, port_id=eb995f09-e7f4-4fe6-84c5-a4659a0666cd, reason: Instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:50:55 user nova-compute[70375]: INFO nova.compute.manager [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Took 2.49 seconds to detach 3 volumes for instance.
Jul 24 17:50:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:50:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:50:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:50:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:50:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:56 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Deleted allocations for instance 4ad9c9c1-db8a-4718-98bf-efc13341efe2
Jul 24 17:50:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4775cb4c-4a31-42f6-b7e4-b9580cecb755 tempest-TaggedBootDevicesTest_v242-623693073 tempest-TaggedBootDevicesTest_v242-623693073-project-member] Lock "4ad9c9c1-db8a-4718-98bf-efc13341efe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.431s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:50:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:02 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221047.8947167, 4ad9c9c1-db8a-4718-98bf-efc13341efe2 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:51:02 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] VM Stopped (Lifecycle Event)
Jul 24 17:51:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1ab65691-1f1c-4810-ad05-0426be40c396 None None] [instance: 4ad9c9c1-db8a-4718-98bf-efc13341efe2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:51:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-changed-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Refreshing instance network info cache due to event network-changed-efb07c38-8d48-4a2e-a178-360ba9cc30d2. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] Acquiring lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] Acquired lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Refreshing network info cache for port efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Ignoring supplied device name: /dev/vdb
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Attaching volume f9ba96f0-bd5d-477a-bd23-b5134723e898 to /dev/vdb
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updated VIF entry in instance network info cache for port efb07c38-8d48-4a2e-a178-360ba9cc30d2. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating instance_info_cache with network_info: [{"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-87142ecf-6002-419c-aa3b-e1db38386739 req-9417bf14-cd6b-4e9c-a7dc-c901a3579198 service nova] Releasing lock "refresh_cache-823fa668-f964-4574-aeec-009ceb0cdc40" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG os_brick.utils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fe4c41-1cc9-4999-9c53-a3c88d573887]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff4af0a-44cb-45a3-a875-b9178c06db7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc7004-3379-42dd-8d20-a0d76ed434f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[46307fdb-b756-4ae2-9d84-7d635c035af1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:07 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:51:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdfb33-23b8-429a-93f5-25a155c245b3]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG os_brick.utils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:07 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating existing volume attachment record: cbdc39f5-8b01-43f8-98b0-163d498b8186 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:51:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:51:10 user nova-compute[70375]: INFO nova.compute.claims [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Claim successful on node user
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:51:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.policy [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '489f6bd0397e442f8967b992adc9a998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd425958d88754a4f8c9a31bbd7d9715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:51:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Creating image(s)
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "/opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "/opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk 1073741824" returned: 0 in 0.051s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Successfully created port: 08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:51:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Cannot resize image /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'migration_context' on Instance uuid ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Ensure instance console log exists: /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Successfully updated port: 08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquired lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-changed-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Refreshing instance network info cache due to event network-changed-08ffec72-e834-4552-928c-234778f5c816. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] Acquiring lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Updating instance_info_cache with network_info: [{"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Releasing lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Instance network_info: |[{"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] Acquired lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Refreshing network info cache for port 08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Start _get_guest_xml network_info=[{"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:51:13 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:13 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1054706891',display_name='tempest-VolumesAdminNegativeTest-server-1054706891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1054706891',id=14,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-g7zu7boe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:51:11Z,user_data=None,user_id='489f6bd0397e442f8967b992adc9a998',uuid=ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'pci_devices' on Instance uuid ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:51:13 user nova-compute[70375]:   <uuid>ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc</uuid>
Jul 24 17:51:13 user nova-compute[70375]:   <name>instance-0000000e</name>
Jul 24 17:51:13 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:51:13 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:51:13 user nova-compute[70375]:   <metadata>
Jul 24 17:51:13 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:51:13 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1054706891</nova:name>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:51:13</nova:creationTime>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:51:13 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:51:13 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:owner>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:user uuid="489f6bd0397e442f8967b992adc9a998">tempest-VolumesAdminNegativeTest-2106539128-project-member</nova:user>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:project uuid="d425958d88754a4f8c9a31bbd7d9715c">tempest-VolumesAdminNegativeTest-2106539128</nova:project>
Jul 24 17:51:13 user nova-compute[70375]:       </nova:owner>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:51:13 user nova-compute[70375]:       <nova:ports>
Jul 24 17:51:13 user nova-compute[70375]:         <nova:port uuid="08ffec72-e834-4552-928c-234778f5c816">
Jul 24 17:51:13 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:51:13 user nova-compute[70375]:         </nova:port>
Jul 24 17:51:13 user nova-compute[70375]:       </nova:ports>
Jul 24 17:51:13 user nova-compute[70375]:     </nova:instance>
Jul 24 17:51:13 user nova-compute[70375]:   </metadata>
Jul 24 17:51:13 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:51:13 user nova-compute[70375]:     <system>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="serial">ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc</entry>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="uuid">ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc</entry>
Jul 24 17:51:13 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:51:13 user nova-compute[70375]:     </system>
Jul 24 17:51:13 user nova-compute[70375]:   </sysinfo>
Jul 24 17:51:13 user nova-compute[70375]:   <os>
Jul 24 17:51:13 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:51:13 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:51:13 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:51:13 user nova-compute[70375]:   </os>
Jul 24 17:51:13 user nova-compute[70375]:   <features>
Jul 24 17:51:13 user nova-compute[70375]:     <acpi/>
Jul 24 17:51:13 user nova-compute[70375]:     <apic/>
Jul 24 17:51:13 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:51:13 user nova-compute[70375]:   </features>
Jul 24 17:51:13 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:51:13 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:51:13 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:51:13 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:51:13 user nova-compute[70375]:   </clock>
Jul 24 17:51:13 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:51:13 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:51:13 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:51:13 user nova-compute[70375]:   </cpu>
Jul 24 17:51:13 user nova-compute[70375]:   <devices>
Jul 24 17:51:13 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:51:13 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:51:13 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk"/>
Jul 24 17:51:13 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:51:13 user nova-compute[70375]:     </disk>
Jul 24 17:51:13 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:51:13 user nova-compute[70375]:       <mac address="fa:16:3e:28:eb:9b"/>
Jul 24 17:51:13 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:51:13 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:51:13 user nova-compute[70375]:       <target dev="tap08ffec72-e8"/>
Jul 24 17:51:13 user nova-compute[70375]:     </interface>
Jul 24 17:51:13 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:51:13 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/console.log" append="off"/>
Jul 24 17:51:13 user nova-compute[70375]:     </serial>
Jul 24 17:51:13 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:51:13 user nova-compute[70375]:     <video>
Jul 24 17:51:13 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:51:13 user nova-compute[70375]:     </video>
Jul 24 17:51:13 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:51:13 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:51:13 user nova-compute[70375]:     </rng>
Jul 24 17:51:13 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:51:13 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:51:13 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:51:13 user nova-compute[70375]:     </memballoon>
Jul 24 17:51:13 user nova-compute[70375]:   </devices>
Jul 24 17:51:13 user nova-compute[70375]: </domain>
Jul 24 17:51:13 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1054706891',display_name='tempest-VolumesAdminNegativeTest-server-1054706891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1054706891',id=14,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-g7zu7boe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:51:11Z,user_data=None,user_id='489f6bd0397e442f8967b992adc9a998',uuid=ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_vif [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08ffec72-e8, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08ffec72-e8, col_values=(('external_ids', {'iface-id': '08ffec72-e834-4552-928c-234778f5c816', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:eb:9b', 'vm-uuid': 'ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:13 user nova-compute[70375]: INFO os_vif [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8')
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] No VIF found with MAC fa:16:3e:28:eb:9b, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Updated VIF entry in instance network info cache for port 08ffec72-e834-4552-928c-234778f5c816. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Updating instance_info_cache with network_info: [{"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a36e2dd-f978-44d2-95b2-c9a168bde4c6 req-8b505603-730f-4779-9b6b-d5603489f701 service nova] Releasing lock "refresh_cache-ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNHsymEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:13 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:13 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:13 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:51:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc8e71-5c86-4da7-839e-ce3e045cd0db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:51:14 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb9117-786d-4285-97f4-b2927aad645f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898] added
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5ca496-ff5e-480d-aeb2-0ce3776cd944]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[571ee83f-15ef-4db9-99d7-bec05e6dbb86]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNHsymEI {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNHsymEI" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f04eea5-569c-468f-9163-b6a9b9285077]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNHsymEI'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a4c76e-077d-46b2-a8a3-87e2aaf983eb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[104447ca-8c59-450f-a00b-c3b5ca1bcf61]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[107fbee3-9595-49d6-b5b1-46c4d5a674cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260]
Jul 24 17:51:14 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafc6d08-0d1f-44ca-b18d-c572155415c1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[441e9fd4-764e-4814-9676-841bbca8e04f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9cb04a-d10d-44ac-8004-a676828da6a9]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNHsymEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:15 user nova-compute[70375]: WARNING nova.compute.manager [req-3ab74dd2-ae2d-40b4-8cb1-d3cef0e3b2bc req-07c46659-abc1-4609-9d18-b822c055ea47 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state building and task_state spawning.
Jul 24 17:51:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23632613531356634', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632613531356634', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:51:15 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:15 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:51:15 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:15 user nova-compute[70375]:   <serial>f9ba96f0-bd5d-477a-bd23-b5134723e898</serial>
Jul 24 17:51:15 user nova-compute[70375]: </disk>
Jul 24 17:51:15 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No VIF found with MAC fa:16:3e:db:dc:02, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:51:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9513e5c2-4cac-4871-a5d3-cb6fa993bb42 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.172s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:17 user nova-compute[70375]: WARNING nova.compute.manager [req-7e27b975-71c8-419d-85fc-549dc2f2187f req-4966e5eb-cbe9-4062-8f8a-e7b6407d26e5 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state building and task_state spawning.
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221077.0926638, ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] VM Resumed (Lifecycle Event)
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Instance spawned successfully.
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221077.0961287, ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] VM Started (Lifecycle Event)
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Took 5.92 seconds to spawn the instance on the hypervisor.
Jul 24 17:51:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:51:17 user nova-compute[70375]: INFO nova.compute.manager [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Took 6.67 seconds to build instance.
Jul 24 17:51:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b910ae01-53a9-489e-99da-0bccf3514183 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.777s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:51:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating instance_info_cache with network_info: [{"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-a32f2c47-1d35-4436-9da4-7c94de7ed79c" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'flavor' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:29 user nova-compute[70375]: INFO nova.compute.manager [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Attaching volume 83d1e070-72bc-4042-a555-39471203d2f8 to /dev/vdb
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.utils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8006c-e0a8-49e8-b7da-44a392fba9dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9ba214-2488-482f-a8c9-9cfad105dd0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb04a5-f8b7-4e9d-905b-b386944e32f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6e7b7-fa10-4c20-9ae6-ab05756efc32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:29 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[245bc99c-143e-4e67-882e-035f78928489]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG os_brick.utils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating existing volume attachment record: 4b12c3dc-b1f3-43e3-9190-878a0e0a17f1 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:51:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:51:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=24.51891326904297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a32f2c47-1d35-4436-9da4-7c94de7ed79c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 823fa668-f964-4574-aeec-009ceb0cdc40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 23c835be-30a5-4353-ac0a-dca4c53e7921 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 2d9bc837-e597-42d5-a8c3-826e42621dbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-changed-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Refreshing instance network info cache due to event network-changed-fba13bd2-e46f-40e4-bb80-1380bc67687d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] Acquiring lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] Acquired lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:33 user nova-compute[70375]: DEBUG nova.network.neutron [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Refreshing network info cache for port fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:51:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updated VIF entry in instance network info cache for port fba13bd2-e46f-40e4-bb80-1380bc67687d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:51:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updating instance_info_cache with network_info: [{"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6780cb01-456d-47c8-81b5-1a332dd5d20d req-3fd7510c-cae5-46e1-89ee-dc0d1fd78d8e service nova] Releasing lock "refresh_cache-23c835be-30a5-4353-ac0a-dca4c53e7921" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:35 user nova-compute[70375]: INFO nova.compute.manager [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Terminating instance
Jul 24 17:51:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-unplugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] No waiting events found dispatching network-vif-unplugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-9763f9af-6622-4c3a-b17f-149719d620d1 req-726c3831-e55f-4881-b4db-2220f1b13e64 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-unplugged-986e75bf-5600-44d7-9629-6b543ad130fc for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:51:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Instance destroyed successfully.
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.objects.instance [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lazy-loading 'resources' on Instance uuid 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-312430646',display_name='tempest-TestVolumeSwap-server-312430646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-312430646',id=8,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2DXKkaT4mFOCtkzDpKhloVu8rHW5CUlHpVQLzR2TPUNlxpNL+gBOdvutgeXAjtEtUz5VjpR3j74UlGZdK7SiVCkfttE7+HxK/sFBzfwAYjmCsD3YP1WAXgt19Tkd4RMA==',key_name='tempest-keypair-192527649',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1466ce4246a54ebaa29ee3e99f20eb6b',ramdisk_id='',reservation_id='r-v34bjtmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1558601436',owner_user_name='tempest-TestVolumeSwap-1558601436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c2d89b17c4483a8ad361f66d614ef0',uuid=5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converting VIF {"id": "986e75bf-5600-44d7-9629-6b543ad130fc", "address": "fa:16:3e:97:c5:b8", "network": {"id": "a37e7808-fbfd-48a2-8c4a-dde6f63a39b4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080743437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466ce4246a54ebaa29ee3e99f20eb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986e75bf-56", "ovs_interfaceid": "986e75bf-5600-44d7-9629-6b543ad130fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG os_vif [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap986e75bf-56, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:36 user nova-compute[70375]: INFO os_vif [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c5:b8,bridge_name='br-int',has_traffic_filtering=True,id=986e75bf-5600-44d7-9629-6b543ad130fc,network=Network(a37e7808-fbfd-48a2-8c4a-dde6f63a39b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986e75bf-56')
Jul 24 17:51:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Deleting instance files /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4_del
Jul 24 17:51:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Deletion of /opt/stack/data/nova/instances/5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4_del complete
Jul 24 17:51:36 user nova-compute[70375]: INFO nova.compute.manager [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 24 17:51:36 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:51:36 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:37 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:37 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:37 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2852ea19-117b-4648-90f8-f2ccc247e35f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:51:37 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18dc416-4497-4698-bc7f-df83a1ece3d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added
Jul 24 17:51:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b695473e-ef63-447a-b968-94d8eca95745]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ecf445-7e3b-463f-8e4c-aef7462aa81b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7217cc-7377-46b3-9e86-706e90ee0c75]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FhbMZjpy'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3692846-dd8a-4709-bad8-e87f5a296f2d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] Acquiring lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] No waiting events found dispatching network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:38 user nova-compute[70375]: WARNING nova.compute.manager [req-663e3419-ec60-4e9f-bffe-33d58dbe82f5 req-dd8ab32c-3e7d-49cf-9c37-3c9e31048fa0 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received unexpected event network-vif-plugged-986e75bf-5600-44d7-9629-6b543ad130fc for instance with vm_state active and task_state deleting.
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b850af38-fe89-4a64-935a-82f5bf654829]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[759e1c63-133d-4cb2-8d09-6a18b63c8ba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:51:38 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:38 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0656dc-4554-41c6-a5f4-bfcda1edaf30]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'flavor' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe10028-5999-4d7a-ae1f-de654b249207]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:38 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f75b2e-5e79-44b1-9a96-faff65308dba]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:38 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Took 1.95 seconds to deallocate network for instance.
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-7006178c-877d-421e-905e-ead1603d817d req-86a6c98d-acd8-4a16-96e2-0f935f62da76 service nova] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Received event network-vif-deleted-986e75bf-5600-44d7-9629-6b543ad130fc {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:38 user nova-compute[70375]: INFO nova.compute.manager [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Attaching volume 039ee101-968f-4229-a32d-90acd57af3c3 to /dev/vdb
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.utils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72537a1-3d59-4969-a405-f47bf687c6bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[53485654-ddf6-43c6-94ef-d3fefe927d7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5bfaa-c17a-4ad4-9d48-450b90ce4817]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54719287-c25a-4755-a68f-f680dfb85bb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:38 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:51:38 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e16a0-3518-40e9-8d82-016426087252]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG os_brick.utils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updating existing volume attachment record: f658b987-e2f6-4110-8675-5ed6f718291b {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:39 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Deleted allocations for instance 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4
Jul 24 17:51:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-22efd8a5-0a52-48eb-9e0c-bc02aeeaf751 tempest-TestVolumeSwap-1558601436 tempest-TestVolumeSwap-1558601436-project-member] Lock "5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.557s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'flavor' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:51:39 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:39 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:51:39 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:39 user nova-compute[70375]:   <serial>83d1e070-72bc-4042-a555-39471203d2f8</serial>
Jul 24 17:51:39 user nova-compute[70375]: </disk>
Jul 24 17:51:39 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No VIF found with MAC fa:16:3e:4d:88:af, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:51:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8e6d9117-fd12-4c5a-b526-3c23d88b6e5f tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.344s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Stashing vm_state: active {{(pid=70375) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'pci_requests' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:51:42 user nova-compute[70375]: INFO nova.compute.claims [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Claim successful on node user
Jul 24 17:51:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'resources' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'pci_devices' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:42 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating resource usage from migration e5f97bff-099a-473d-b0c0-0a81837a4346
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.621s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:43 user nova-compute[70375]: INFO nova.compute.manager [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Migrating
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:43 user nova-compute[70375]: INFO nova.compute.rpcapi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-changed-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Refreshing instance network info cache due to event network-changed-3289c41e-38ee-49b1-a5fe-91ac1a27947e. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] Acquiring lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] Acquired lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Refreshing network info cache for port 3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:44 user nova-compute[70375]: INFO nova.compute.manager [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Terminating instance
Jul 24 17:51:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Starting migrate_disk_and_power_off {{(pid=70375) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 17:51:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Instance destroyed successfully.
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'resources' on Instance uuid 2d9bc837-e597-42d5-a8c3-826e42621dbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1836582341',display_name='tempest-AttachVolumeNegativeTest-server-1836582341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1836582341',id=13,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhx/xc5v7vPu96/V3riWSEisrTVgThkyOIw4l/CObPDbTOugH6//Lu8uX6vFwBEczV1XuQ8oqGLDRD/IKBqIkLc2Bywo4HiURPE0rARKBqDu7ea/MdK/iT5tIzl+7uFCA==',key_name='tempest-keypair-827887430',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-olqqbydq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=2d9bc837-e597-42d5-a8c3-826e42621dbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_vif [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3289c41e-38, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:45 user nova-compute[70375]: WARNING nova.compute.manager [req-071e4b86-a18e-46d8-ab02-0fe30b2e7ecc req-e69c459d-b9a1-4ad9-b9ef-294d50f8ea64 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state active and task_state resize_migrating.
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: INFO os_vif [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:41:c8,bridge_name='br-int',has_traffic_filtering=True,id=3289c41e-38ee-49b1-a5fe-91ac1a27947e,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3289c41e-38')
Jul 24 17:51:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Deleting instance files /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc_del
Jul 24 17:51:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Deletion of /opt/stack/data/nova/instances/2d9bc837-e597-42d5-a8c3-826e42621dbc_del complete
Jul 24 17:51:45 user nova-compute[70375]: INFO nova.compute.manager [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance destroyed successfully.
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b0448f-d9, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:45 user nova-compute[70375]: INFO os_vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:51:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:45 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe523923-7740-42a5-8725-308bcb07b8b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:51:45 user nova-compute[70375]: No targets found.
Jul 24 17:51:45 user nova-compute[70375]: iSNS:
Jul 24 17:51:45 user nova-compute[70375]: No targets found.
Jul 24 17:51:45 user nova-compute[70375]: STATIC:
Jul 24 17:51:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898
Jul 24 17:51:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:51:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:51:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:45 user nova-compute[70375]: FIRMWARE:
Jul 24 17:51:45 user nova-compute[70375]: No targets found.
Jul 24 17:51:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:51:45 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:51:45 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[75425676-46e5-4bc8-9c9d-e94605c0eda9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac43b6-5f67-4e54-a17a-4c59ac31d7d3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6503597e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[318bc12d-635b-4a58-8310-3c56b3bfe99e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.040s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[795802e5-5fb2-41c7-8369-98e555d72d5d]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d00b25-54e3-4430-9967-b3384543fd9f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:51:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f155f2-e48e-4a7a-8035-3fcd49f13930]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1def915-2a02-4bec-a432-17b72e35a263]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-unplugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] No waiting events found dispatching network-vif-unplugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-0ea6e5f6-7e2a-4809-883c-02b904dd8c4a req-ad1aa113-b3bb-4966-abad-44ac44f17b78 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-unplugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2ebe8e-603e-4bd3-9e44-f513b243f42b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:51:46 user nova-compute[70375]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a8565-d6ba-4a0c-9336-bf2d097d6120]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== disconnect_volume: return (425ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updated VIF entry in instance network info cache for port 3289c41e-38ee-49b1-a5fe-91ac1a27947e. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updating instance_info_cache with network_info: [{"id": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "address": "fa:16:3e:ba:41:c8", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3289c41e-38", "ovs_interfaceid": "3289c41e-38ee-49b1-a5fe-91ac1a27947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-842c9a43-e183-4cfc-b76c-0f94e4f08e67 req-0aa142c3-4dec-4706-98b3-b3d89e6a38a4 service nova] Releasing lock "refresh_cache-2d9bc837-e597-42d5-a8c3-826e42621dbc" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_resize/disk /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:46 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Took 1.20 seconds to deallocate network for instance.
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "cp -r /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_resize/disk /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk" returned: 0 in 0.456s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_resize/disk.info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk.info {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "cp -r /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_resize/disk.info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk.info" returned: 0 in 0.046s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acuqoPjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:47 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:47 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:47 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:51:47 user nova-compute[70375]: INFO nova.compute.manager [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Detaching volume f9ba96f0-bd5d-477a-bd23-b5134723e898
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e26291-9606-4c83-80ce-9bb4b886be72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:51:47 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Deleted allocations for instance 2d9bc837-e597-42d5-a8c3-826e42621dbc
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: INFO nova.virt.block_device [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Attempting to driver detach volume f9ba96f0-bd5d-477a-bd23-b5134723e898 from mountpoint /dev/vdb
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcb6452-a5b9-4de0-a1f6-f380ecdb884e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3] added
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Attempting to detach device vdb from instance 823fa668-f964-4574-aeec-009ceb0cdc40 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:51:47 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:47 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:51:47 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:47 user nova-compute[70375]:   <serial>f9ba96f0-bd5d-477a-bd23-b5134723e898</serial>
Jul 24 17:51:47 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:51:47 user nova-compute[70375]: </disk>
Jul 24 17:51:47 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[858bac18-adf8-4c21-aaec-c8f09ace7713]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully detached device vdb from instance 823fa668-f964-4574-aeec-009ceb0cdc40 from the persistent domain config.
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 823fa668-f964-4574-aeec-009ceb0cdc40 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:51:47 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:47 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:51:47 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:47 user nova-compute[70375]:   <serial>f9ba96f0-bd5d-477a-bd23-b5134723e898</serial>
Jul 24 17:51:47 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:51:47 user nova-compute[70375]: </disk>
Jul 24 17:51:47 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[194649cf-5f95-4648-bfb3-fbef343c959d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acuqoPjD {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a98a39eb-8a04-4916-9b06-7feb5231c749 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acuqoPjD" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea815216-f104-45fc-82cb-7b62a8555c37]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'acuqoPjD'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f87d9-5ea4-41ab-9bfc-e3e4d92e339a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5ea8eb-2e64-4379-9465-b22b8b4ed0d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:47 user nova-compute[70375]: WARNING nova.compute.manager [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state active and task_state resize_migrating.
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-d3b3781b-ce82-4167-b362-4689c9107fae req-cf72ef3b-2921-41a5-b041-ae986c1d370d service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-deleted-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[42014e83-abb0-45de-b308-f25eb39900d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260]
Jul 24 17:51:47 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1191c03-e5c2-4f5c-bcb4-4e292392c23f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da3496e-5325-43fa-8c2a-c33181a33bf1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c1de0-e35f-4548-8a62-146b0744c0b6]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acuqoPjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221107.7891443, 823fa668-f964-4574-aeec-009ceb0cdc40 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:51:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully detached device vdb from instance 823fa668-f964-4574-aeec-009ceb0cdc40 from the live domain config.
Jul 24 17:51:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNHsymEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:47 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] Acquiring lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] Lock "2d9bc837-e597-42d5-a8c3-826e42621dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] No waiting events found dispatching network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:48 user nova-compute[70375]: WARNING nova.compute.manager [req-4bd77100-16e3-4233-9f85-ca20f2adda38 req-f9d49e3a-35fd-4a99-a35d-2c3e81a37294 service nova] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Received unexpected event network-vif-plugged-3289c41e-38ee-49b1-a5fe-91ac1a27947e for instance with vm_state deleted and task_state None.
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Port 68b0448f-d9ad-4486-9db5-9d9f1f626cae binding to destination host user is already ACTIVE {{(pid=70375) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23736336535326262', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736336535326262', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.816s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'flavor' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bd5cb2-b74a-446c-8d8f-adcd7d02d238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:51:48 user nova-compute[70375]: No targets found.
Jul 24 17:51:48 user nova-compute[70375]: iSNS:
Jul 24 17:51:48 user nova-compute[70375]: No targets found.
Jul 24 17:51:48 user nova-compute[70375]: STATIC:
Jul 24 17:51:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898
Jul 24 17:51:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:51:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:48 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3
Jul 24 17:51:48 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:48 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:48 user nova-compute[70375]: FIRMWARE:
Jul 24 17:51:48 user nova-compute[70375]: No targets found.
Jul 24 17:51:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:51:48 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:51:48 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:51:48 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:48 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:51:48 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:48 user nova-compute[70375]:   <serial>039ee101-968f-4229-a32d-90acd57af3c3</serial>
Jul 24 17:51:48 user nova-compute[70375]: </disk>
Jul 24 17:51:48 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7368dab2-f7d4-4501-8a1c-ecc2e89fb6da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[167060cf-38d6-47f4-8e66-7e07381ea6e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe64838ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b032dc82-a57c-4434-8926-ad0f8dfa87ca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5df90b-4d16-40ed-8b01-b5e5b2834028]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f323692-526c-4147-82ca-ae64977e7908]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35787d-9060-430e-a367-18d42b0a9a3a]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea6049-7a88-4127-87a1-6e493279271c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded10947-0dc3-4931-aa40-11a5246a3a68]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260]
Jul 24 17:51:48 user nova-compute[70375]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20eceb0-4d60-4932-afd4-d5ff631fdb6d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== disconnect_volume: return (1150ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] No VIF found with MAC fa:16:3e:56:83:5a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ab77e701-fc90-4bd0-b78b-59a63455268c tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.633s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.utils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db75cfca-92a0-4776-8213-8448cce062f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b385da-f12e-4d06-a3f1-d4a2b1f01a19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892fa79-6566-4558-acf6-deafae619df5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f7247-6d29-4846-98f2-5f5d90741f77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:51:49 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[19716347-b5e3-44db-993b-cd6936bce1c1]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG os_brick.utils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0047a11a-17db-4dff-890d-862a8c4bdd3d tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.833s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.660s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:50 user nova-compute[70375]: INFO nova.compute.manager [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Terminating instance
Jul 24 17:51:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-unplugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] No waiting events found dispatching network-vif-unplugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-75f6eda1-f2ad-41e1-93e4-321b366b9910 req-ab4f28df-b3c1-4f97-9823-e353a565d892 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-unplugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:51:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Instance destroyed successfully.
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'resources' on Instance uuid 823fa668-f964-4574-aeec-009ceb0cdc40 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1409292148',display_name='tempest-VolumesSnapshotTestJSON-instance-1409292148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1409292148',id=11,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKRE82jKxaaJadLhwv/5SqYJSooBCCa0+eR/1MUgpOjH7ks7lm45KCTrFvtVpdd/Ad9jNtZE5Yor3hOmV6Odm3zrxxQCyPYDZm1GiCb+bTjQsTBjVaNORz0DnfbcGX9jA==',key_name='tempest-keypair-2121430496',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-uca84o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=823fa668-f964-4574-aeec-009ceb0cdc40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "address": "fa:16:3e:db:dc:02", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb07c38-8d", "ovs_interfaceid": "efb07c38-8d48-4a2e-a178-360ba9cc30d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_vif [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefb07c38-8d, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:51 user nova-compute[70375]: INFO os_vif [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:dc:02,bridge_name='br-int',has_traffic_filtering=True,id=efb07c38-8d48-4a2e-a178-360ba9cc30d2,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb07c38-8d')
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNHsymEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:51 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b85cd-2724-4de1-8acc-3110a7d56bfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:51:51 user nova-compute[70375]: No targets found.
Jul 24 17:51:51 user nova-compute[70375]: iSNS:
Jul 24 17:51:51 user nova-compute[70375]: No targets found.
Jul 24 17:51:51 user nova-compute[70375]: STATIC:
Jul 24 17:51:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:51:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3
Jul 24 17:51:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:51 user nova-compute[70375]: FIRMWARE:
Jul 24 17:51:51 user nova-compute[70375]: No targets found.
Jul 24 17:51:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:51:51 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:51:51 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba96f0-bd5d-477a-bd23-b5134723e898', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbc8f0b-7358-46df-a09b-0f9101f33952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5fdcb9-87b9-4515-ab46-2000315e3509]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:51 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:51 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6501b8430>, {}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Disconnecting from: [] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== disconnect_volume: return (83ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Deleting instance files /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40_del
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Deletion of /opt/stack/data/nova/instances/823fa668-f964-4574-aeec-009ceb0cdc40_del complete
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.compute.manager [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221096.4446874, 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] VM Stopped (Lifecycle Event)
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2c9a188b-bd82-43ee-883d-00685cc9614d None None] [instance: 5b5c5899-3cf4-4a4f-aa99-2ef9da232ad4] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.compute.manager [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Detaching volume 039ee101-968f-4229-a32d-90acd57af3c3
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.virt.block_device [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Attempting to driver detach volume 039ee101-968f-4229-a32d-90acd57af3c3 from mountpoint /dev/vdb
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Attempting to detach device vdb from instance 23c835be-30a5-4353-ac0a-dca4c53e7921 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:51:51 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:51 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:51:51 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:51 user nova-compute[70375]:   <serial>039ee101-968f-4229-a32d-90acd57af3c3</serial>
Jul 24 17:51:51 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:51:51 user nova-compute[70375]: </disk>
Jul 24 17:51:51 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:51:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Successfully detached device vdb from instance 23c835be-30a5-4353-ac0a-dca4c53e7921 from the persistent domain config.
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23c835be-30a5-4353-ac0a-dca4c53e7921 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:51:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:51:51 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:51 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:51:51 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:51:51 user nova-compute[70375]:   <serial>039ee101-968f-4229-a32d-90acd57af3c3</serial>
Jul 24 17:51:51 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:51:51 user nova-compute[70375]: </disk>
Jul 24 17:51:51 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221112.3165815, 23c835be-30a5-4353-ac0a-dca4c53e7921 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:51:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Successfully detached device vdb from instance 23c835be-30a5-4353-ac0a-dca4c53e7921 from the live domain config.
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acuqoPjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:52 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9cf3ff-dd91-4457-9329-97026fde375b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:51:52 user nova-compute[70375]: No targets found.
Jul 24 17:51:52 user nova-compute[70375]: iSNS:
Jul 24 17:51:52 user nova-compute[70375]: No targets found.
Jul 24 17:51:52 user nova-compute[70375]: STATIC:
Jul 24 17:51:52 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:51:52 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:52 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:52 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3
Jul 24 17:51:52 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:51:52 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:51:52 user nova-compute[70375]: FIRMWARE:
Jul 24 17:51:52 user nova-compute[70375]: No targets found.
Jul 24 17:51:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:51:52 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:51:52 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce6582-c43d-46a2-adbe-f5605f1dd4b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[73616a31-07bd-4a1b-8ef1-1ca48a7b4ef7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:52 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 (non-flash)
Jul 24 17:51:52 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe65125e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99d96d2-3b1a-451a-aaa5-3d975f0315dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d960e4-354e-4b1f-8e1b-676519dc3c17]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a70167-f162-4467-b58c-52d44f4aecd9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[023368e4-f596-40ca-b720-45d4b270125d]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[78618888-2e89-4f4a-8dde-6ee3b46d84a1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] Acquiring lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] Lock "823fa668-f964-4574-aeec-009ceb0cdc40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] No waiting events found dispatching network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:51:52 user nova-compute[70375]: WARNING nova.compute.manager [req-8488b91b-dbd1-4838-91fe-17f1c5338f0e req-9b0c3b4e-713c-4311-9c41-5541f59454d9 service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received unexpected event network-vif-plugged-efb07c38-8d48-4a2e-a178-360ba9cc30d2 for instance with vm_state active and task_state deleting.
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d79ca-f87e-4726-b4dd-457099296d9c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260]
Jul 24 17:51:52 user nova-compute[70375]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039ee101-968f-4229-a32d-90acd57af3c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c9b45-be26-4742-ac13-a757fab4cef4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] <== disconnect_volume: return (342ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:52 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Took 1.46 seconds to deallocate network for instance.
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-036b9b07-8b41-442e-9873-431ce376b8aa req-259a1a16-b63f-469e-8ef6-5c161a25507f service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Received event network-vif-deleted-efb07c38-8d48-4a2e-a178-360ba9cc30d2 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:51:52 user nova-compute[70375]: INFO nova.compute.manager [req-036b9b07-8b41-442e-9873-431ce376b8aa req-259a1a16-b63f-469e-8ef6-5c161a25507f service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Neutron deleted interface efb07c38-8d48-4a2e-a178-360ba9cc30d2; detaching it from the instance and deleting it from the info cache
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.network.neutron [req-036b9b07-8b41-442e-9873-431ce376b8aa req-259a1a16-b63f-469e-8ef6-5c161a25507f service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:51:52 user nova-compute[70375]: WARNING nova.volume.cinder [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Attachment cbdc39f5-8b01-43f8-98b0-163d498b8186 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cbdc39f5-8b01-43f8-98b0-163d498b8186. (HTTP 404) (Request-ID: req-4cdaed58-eac6-4960-9753-2be8d5b3f7f4)
Jul 24 17:51:52 user nova-compute[70375]: INFO nova.compute.manager [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Took 0.06 seconds to detach 1 volumes for instance.
Jul 24 17:51:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-036b9b07-8b41-442e-9873-431ce376b8aa req-259a1a16-b63f-469e-8ef6-5c161a25507f service nova] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Detach interface failed, port_id=efb07c38-8d48-4a2e-a178-360ba9cc30d2, reason: Instance 823fa668-f964-4574-aeec-009ceb0cdc40 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:53 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:51:53 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:51:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:53 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Deleted allocations for instance 823fa668-f964-4574-aeec-009ceb0cdc40
Jul 24 17:51:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'flavor' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8f36979-6f0f-4ef7-a6c7-d72108a394e5 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.078s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1be31f28-dcfb-4e82-b113-a9b65e4c6878 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "823fa668-f964-4574-aeec-009ceb0cdc40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.779s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Starting finish_migration {{(pid=70375) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 17:51:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Creating image(s)
Jul 24 17:51:57 user nova-compute[70375]: DEBUG nova.objects.instance [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk. size=21474836480 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk 21474836480 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk 21474836480" returned: 0 in 0.193s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Ensure instance console log exists: /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start _get_guest_xml network_info=[{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '50833267-b921-42a6-a8d2-18a083f89705', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '81fd89d8-c2b9-4398-83f5-0ddb45f14722', 'attached_at': '2023-07-24T17:51:57.000000', 'detached_at': '', 'volume_id': '83d1e070-72bc-4042-a555-39471203d2f8', 'serial': '83d1e070-72bc-4042-a555-39471203d2f8'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:51:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:51:58 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:58 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:51:58 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f573ea-55c3-4999-a6d8-05efd2f9032d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:51:58 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f24ea-ab4f-48e5-8903-c96b9736e3a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58cf84-a5c1-456c-8105-bca551b3846f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980a885-f015-4c94-9449-7c76183de24f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc464866-97b8-42b6-82e4-c7dbec4005a9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FhbMZjpy'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b6cf8-7307-4244-a522-cc48cbfabb0b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9418ad0-df75-4fac-b5b5-6e701a92b7ca]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca9b13f-f74b-4ffa-ab63-cb6795c092a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:51:58 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[603c8b21-df0b-4798-8011-0addc5fab8d4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2d5e8-b324-4bc1-9882-162b749f2b1b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:51:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c047aa-7844-4f1c-94c2-4c9e41a914cd]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:51:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:51:59 user nova-compute[70375]:   <uuid>81fd89d8-c2b9-4398-83f5-0ddb45f14722</uuid>
Jul 24 17:51:59 user nova-compute[70375]:   <name>instance-00000005</name>
Jul 24 17:51:59 user nova-compute[70375]:   <memory>2097152</memory>
Jul 24 17:51:59 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:51:59 user nova-compute[70375]:   <metadata>
Jul 24 17:51:59 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:51:59 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherB-server-358915896</nova:name>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:51:58</nova:creationTime>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:flavor name="m1.small">
Jul 24 17:51:59 user nova-compute[70375]:         <nova:memory>2048</nova:memory>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:disk>20</nova:disk>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:51:59 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:owner>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:user uuid="49c33bc394214fa1a864e79cdef00465">tempest-ServerActionsTestOtherB-1934690611-project-member</nova:user>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:project uuid="a79f1241a80f4fe498df5e46217254d1">tempest-ServerActionsTestOtherB-1934690611</nova:project>
Jul 24 17:51:59 user nova-compute[70375]:       </nova:owner>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:51:59 user nova-compute[70375]:       <nova:ports>
Jul 24 17:51:59 user nova-compute[70375]:         <nova:port uuid="68b0448f-d9ad-4486-9db5-9d9f1f626cae">
Jul 24 17:51:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:51:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:51:59 user nova-compute[70375]:       </nova:ports>
Jul 24 17:51:59 user nova-compute[70375]:     </nova:instance>
Jul 24 17:51:59 user nova-compute[70375]:   </metadata>
Jul 24 17:51:59 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:51:59 user nova-compute[70375]:     <system>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="serial">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="uuid">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:51:59 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:51:59 user nova-compute[70375]:     </system>
Jul 24 17:51:59 user nova-compute[70375]:   </sysinfo>
Jul 24 17:51:59 user nova-compute[70375]:   <os>
Jul 24 17:51:59 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:51:59 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:51:59 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:51:59 user nova-compute[70375]:   </os>
Jul 24 17:51:59 user nova-compute[70375]:   <features>
Jul 24 17:51:59 user nova-compute[70375]:     <acpi/>
Jul 24 17:51:59 user nova-compute[70375]:     <apic/>
Jul 24 17:51:59 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:51:59 user nova-compute[70375]:   </features>
Jul 24 17:51:59 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:51:59 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:51:59 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:51:59 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:51:59 user nova-compute[70375]:   </clock>
Jul 24 17:51:59 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:51:59 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:51:59 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:51:59 user nova-compute[70375]:   </cpu>
Jul 24 17:51:59 user nova-compute[70375]:   <devices>
Jul 24 17:51:59 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:51:59 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:51:59 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk"/>
Jul 24 17:51:59 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:51:59 user nova-compute[70375]:     </disk>
Jul 24 17:51:59 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:51:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:51:59 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 17:51:59 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:51:59 user nova-compute[70375]:       <serial>83d1e070-72bc-4042-a555-39471203d2f8</serial>
Jul 24 17:51:59 user nova-compute[70375]:     </disk>
Jul 24 17:51:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:51:59 user nova-compute[70375]:       <mac address="fa:16:3e:4d:88:af"/>
Jul 24 17:51:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:51:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:51:59 user nova-compute[70375]:       <target dev="tap68b0448f-d9"/>
Jul 24 17:51:59 user nova-compute[70375]:     </interface>
Jul 24 17:51:59 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:51:59 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/console.log" append="off"/>
Jul 24 17:51:59 user nova-compute[70375]:     </serial>
Jul 24 17:51:59 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:51:59 user nova-compute[70375]:     <video>
Jul 24 17:51:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:51:59 user nova-compute[70375]:     </video>
Jul 24 17:51:59 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:51:59 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:51:59 user nova-compute[70375]:     </rng>
Jul 24 17:51:59 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:51:59 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:51:59 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:51:59 user nova-compute[70375]:     </memballoon>
Jul 24 17:51:59 user nova-compute[70375]:   </devices>
Jul 24 17:51:59 user nova-compute[70375]: </domain>
Jul 24 17:51:59 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1962594089-network", "vif_mac": "fa:16:3e:4d:88:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG os_vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b0448f-d9, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b0448f-d9, col_values=(('external_ids', {'iface-id': '68b0448f-d9ad-4486-9db5-9d9f1f626cae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:88:af', 'vm-uuid': '81fd89d8-c2b9-4398-83f5-0ddb45f14722'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:51:59 user nova-compute[70375]: INFO os_vif [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:51:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] No VIF found with MAC fa:16:3e:4d:88:af, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:52:00 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221105.2516208, 2d9bc837-e597-42d5-a8c3-826e42621dbc => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:00 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] VM Stopped (Lifecycle Event)
Jul 24 17:52:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5c5da6c-26f8-4181-8424-5fcba25527bb None None] [instance: 2d9bc837-e597-42d5-a8c3-826e42621dbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:00 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221105.7446477, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:00 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Stopped (Lifecycle Event)
Jul 24 17:52:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d97a6aa0-c2d5-41c1-bb50-0af66c7c9732 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:01 user nova-compute[70375]: WARNING nova.compute.manager [req-e7266c1f-a6ff-4e9b-b21c-35f422e3c0e1 req-5c0af6d1-4806-49f5-8990-ae6e14e50a3d service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state active and task_state resize_finish.
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.compute.claims [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Claim successful on node user
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221123.3020823, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Resumed (Lifecycle Event)
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance running successfully.
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Failed to set time: agent not configured {{(pid=70375) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-81be78ec-46e5-40ed-959d-56b839eb8616 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] finish_migration finished successfully. {{(pid=70375) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221123.3023257, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Started (Lifecycle Event)
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:03 user nova-compute[70375]: WARNING nova.compute.manager [req-a0ce4e73-dd1c-4332-b90e-159c8cc4c42c req-b67d3ae4-dc60-4401-b73b-908471a3413e service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state active and task_state resize_finish.
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:52:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:52:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.policy [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fb73acfd51b4e1ea6efb319ce639881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444fa91ae1a496987218fedaf7b5e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:52:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Creating image(s)
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.179s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk 1073741824" returned: 0 in 0.059s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Successfully created port: 13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Cannot resize image /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'migration_context' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Ensure instance console log exists: /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Successfully updated port: 13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-changed-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing instance network info cache due to event network-changed-13da2668-5eab-4063-be21-265d9433e5f8. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221111.090851, 823fa668-f964-4574-aeec-009ceb0cdc40 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:06 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] VM Stopped (Lifecycle Event)
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c3783932-9db3-4b09-b6d8-63adfcc56cfc None None] [instance: 823fa668-f964-4574-aeec-009ceb0cdc40] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Instance network_info: |[{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing network info cache for port 13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Start _get_guest_xml network_info=[{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:52:06 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:06 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'pci_devices' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:52:06 user nova-compute[70375]:   <uuid>262e5d9e-034c-4dc6-a777-49cbc2e697a3</uuid>
Jul 24 17:52:06 user nova-compute[70375]:   <name>instance-0000000f</name>
Jul 24 17:52:06 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:52:06 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:52:06 user nova-compute[70375]:   <metadata>
Jul 24 17:52:06 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:52:06 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:52:06</nova:creationTime>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:52:06 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:52:06 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:owner>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:52:06 user nova-compute[70375]:       </nova:owner>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:52:06 user nova-compute[70375]:       <nova:ports>
Jul 24 17:52:06 user nova-compute[70375]:         <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:52:06 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:52:06 user nova-compute[70375]:         </nova:port>
Jul 24 17:52:06 user nova-compute[70375]:       </nova:ports>
Jul 24 17:52:06 user nova-compute[70375]:     </nova:instance>
Jul 24 17:52:06 user nova-compute[70375]:   </metadata>
Jul 24 17:52:06 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:52:06 user nova-compute[70375]:     <system>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="serial">262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="uuid">262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:52:06 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:52:06 user nova-compute[70375]:     </system>
Jul 24 17:52:06 user nova-compute[70375]:   </sysinfo>
Jul 24 17:52:06 user nova-compute[70375]:   <os>
Jul 24 17:52:06 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:52:06 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:52:06 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:52:06 user nova-compute[70375]:   </os>
Jul 24 17:52:06 user nova-compute[70375]:   <features>
Jul 24 17:52:06 user nova-compute[70375]:     <acpi/>
Jul 24 17:52:06 user nova-compute[70375]:     <apic/>
Jul 24 17:52:06 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:52:06 user nova-compute[70375]:   </features>
Jul 24 17:52:06 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:52:06 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:52:06 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:52:06 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:52:06 user nova-compute[70375]:   </clock>
Jul 24 17:52:06 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:52:06 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:52:06 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:52:06 user nova-compute[70375]:   </cpu>
Jul 24 17:52:06 user nova-compute[70375]:   <devices>
Jul 24 17:52:06 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:52:06 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:52:06 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk"/>
Jul 24 17:52:06 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:52:06 user nova-compute[70375]:     </disk>
Jul 24 17:52:06 user nova-compute[70375]:     <disk type="file" device="cdrom">
Jul 24 17:52:06 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 17:52:06 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config"/>
Jul 24 17:52:06 user nova-compute[70375]:       <target dev="hda" bus="ide"/>
Jul 24 17:52:06 user nova-compute[70375]:     </disk>
Jul 24 17:52:06 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:52:06 user nova-compute[70375]:       <mac address="fa:16:3e:ac:2c:72"/>
Jul 24 17:52:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:06 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:52:06 user nova-compute[70375]:       <target dev="tap13da2668-5e"/>
Jul 24 17:52:06 user nova-compute[70375]:     </interface>
Jul 24 17:52:06 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:52:06 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log" append="off"/>
Jul 24 17:52:06 user nova-compute[70375]:     </serial>
Jul 24 17:52:06 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:52:06 user nova-compute[70375]:     <video>
Jul 24 17:52:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:06 user nova-compute[70375]:     </video>
Jul 24 17:52:06 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:52:06 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:52:06 user nova-compute[70375]:     </rng>
Jul 24 17:52:06 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:52:06 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:52:06 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:52:06 user nova-compute[70375]:     </memballoon>
Jul 24 17:52:06 user nova-compute[70375]:   </devices>
Jul 24 17:52:06 user nova-compute[70375]: </domain>
Jul 24 17:52:06 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG os_vif [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13da2668-5e, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13da2668-5e, col_values=(('external_ids', {'iface-id': '13da2668-5eab-4063-be21-265d9433e5f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:2c:72', 'vm-uuid': '262e5d9e-034c-4dc6-a777-49cbc2e697a3'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:06 user nova-compute[70375]: INFO os_vif [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e')
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name hda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No VIF found with MAC fa:16:3e:ac:2c:72, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:52:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Using config drive
Jul 24 17:52:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Creating config drive at /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config
Jul 24 17:52:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgzcrgm20 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgzcrgm20" returned: 0 in 0.072s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updated VIF entry in instance network info cache for port 13da2668-5eab-4063-be21-265d9433e5f8. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:52:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fa6733dc-1652-4744-8adf-6db7992aa746 req-34c10944-f1d8-4fc4-a500-21559ebce4a9 service nova] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:08 user nova-compute[70375]: WARNING nova.compute.manager [req-080a502c-346b-4b33-8e18-ca647946d917 req-f51a8abc-8b65-4945-b2b9-11246999cceb service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 for instance with vm_state building and task_state spawning.
Jul 24 17:52:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:10 user nova-compute[70375]: WARNING nova.compute.manager [req-0b26c462-4aba-4e15-a79b-c5718bb01711 req-21552131-3951-44e4-b342-15d638d80891 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 for instance with vm_state building and task_state spawning.
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221130.8915112, 262e5d9e-034c-4dc6-a777-49cbc2e697a3 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] VM Resumed (Lifecycle Event)
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:52:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Instance spawned successfully.
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221130.8926928, 262e5d9e-034c-4dc6-a777-49cbc2e697a3 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] VM Started (Lifecycle Event)
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:52:11 user nova-compute[70375]: INFO nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Took 6.89 seconds to spawn the instance on the hypervisor.
Jul 24 17:52:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:11 user nova-compute[70375]: INFO nova.compute.manager [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Took 7.94 seconds to build instance.
Jul 24 17:52:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-550476d6-7952-4077-852c-7aaf5fef7488 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.051s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:52:16 user nova-compute[70375]: INFO nova.compute.claims [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Claim successful on node user
Jul 24 17:52:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:52:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.policy [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa75ae32ac1049f794ce2f8433df6529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07a82b57ae84e8892d950cdc0d7507b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:52:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Creating image(s)
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk 1073741824" returned: 0 in 0.057s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.159s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Successfully created port: cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Cannot resize image /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'migration_context' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Ensure instance console log exists: /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Successfully updated port: cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing instance network info cache due to event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance network_info: |[{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start _get_guest_xml network_info=[{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:52:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-180884339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_devices' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:52:19 user nova-compute[70375]:   <uuid>9228b8cf-e00a-4a57-9762-3e9063199d63</uuid>
Jul 24 17:52:19 user nova-compute[70375]:   <name>instance-00000010</name>
Jul 24 17:52:19 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:52:19 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:52:19 user nova-compute[70375]:   <metadata>
Jul 24 17:52:19 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:52:19 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherA-server-180884339</nova:name>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:52:19</nova:creationTime>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:52:19 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:52:19 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:owner>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:user uuid="aa75ae32ac1049f794ce2f8433df6529">tempest-ServerActionsTestOtherA-528723047-project-member</nova:user>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:project uuid="d07a82b57ae84e8892d950cdc0d7507b">tempest-ServerActionsTestOtherA-528723047</nova:project>
Jul 24 17:52:19 user nova-compute[70375]:       </nova:owner>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:52:19 user nova-compute[70375]:       <nova:ports>
Jul 24 17:52:19 user nova-compute[70375]:         <nova:port uuid="cc33dfa8-db53-43b9-846b-e8f09e846c71">
Jul 24 17:52:19 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:52:19 user nova-compute[70375]:         </nova:port>
Jul 24 17:52:19 user nova-compute[70375]:       </nova:ports>
Jul 24 17:52:19 user nova-compute[70375]:     </nova:instance>
Jul 24 17:52:19 user nova-compute[70375]:   </metadata>
Jul 24 17:52:19 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:52:19 user nova-compute[70375]:     <system>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="serial">9228b8cf-e00a-4a57-9762-3e9063199d63</entry>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="uuid">9228b8cf-e00a-4a57-9762-3e9063199d63</entry>
Jul 24 17:52:19 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:52:19 user nova-compute[70375]:     </system>
Jul 24 17:52:19 user nova-compute[70375]:   </sysinfo>
Jul 24 17:52:19 user nova-compute[70375]:   <os>
Jul 24 17:52:19 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:52:19 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:52:19 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:52:19 user nova-compute[70375]:   </os>
Jul 24 17:52:19 user nova-compute[70375]:   <features>
Jul 24 17:52:19 user nova-compute[70375]:     <acpi/>
Jul 24 17:52:19 user nova-compute[70375]:     <apic/>
Jul 24 17:52:19 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:52:19 user nova-compute[70375]:   </features>
Jul 24 17:52:19 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:52:19 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:52:19 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:52:19 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:52:19 user nova-compute[70375]:   </clock>
Jul 24 17:52:19 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:52:19 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:52:19 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:52:19 user nova-compute[70375]:   </cpu>
Jul 24 17:52:19 user nova-compute[70375]:   <devices>
Jul 24 17:52:19 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:52:19 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:52:19 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk"/>
Jul 24 17:52:19 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:52:19 user nova-compute[70375]:     </disk>
Jul 24 17:52:19 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:52:19 user nova-compute[70375]:       <mac address="fa:16:3e:19:ad:ce"/>
Jul 24 17:52:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:19 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:52:19 user nova-compute[70375]:       <target dev="tapcc33dfa8-db"/>
Jul 24 17:52:19 user nova-compute[70375]:     </interface>
Jul 24 17:52:19 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:52:19 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/console.log" append="off"/>
Jul 24 17:52:19 user nova-compute[70375]:     </serial>
Jul 24 17:52:19 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:52:19 user nova-compute[70375]:     <video>
Jul 24 17:52:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:19 user nova-compute[70375]:     </video>
Jul 24 17:52:19 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:52:19 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:52:19 user nova-compute[70375]:     </rng>
Jul 24 17:52:19 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:52:19 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:52:19 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:52:19 user nova-compute[70375]:     </memballoon>
Jul 24 17:52:19 user nova-compute[70375]:   </devices>
Jul 24 17:52:19 user nova-compute[70375]: </domain>
Jul 24 17:52:19 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-180884339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG os_vif [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc33dfa8-db, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc33dfa8-db, col_values=(('external_ids', {'iface-id': 'cc33dfa8-db53-43b9-846b-e8f09e846c71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:ad:ce', 'vm-uuid': '9228b8cf-e00a-4a57-9762-3e9063199d63'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:19 user nova-compute[70375]: INFO os_vif [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db')
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No VIF found with MAC fa:16:3e:19:ad:ce, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:52:19 user nova-compute[70375]: INFO nova.compute.manager [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Rescuing
Jul 24 17:52:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated VIF entry in instance network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3363216d-eefb-46f2-91d5-1049b573c9eb req-ce54dc0e-5de7-41b9-9a8a-da7a270a4723 service nova] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:20 user nova-compute[70375]: WARNING nova.compute.manager [req-b4900824-5e59-4c8c-9736-804e2fdd9628 req-92296e78-50c8-4dd2-8aba-6050d09d5fb7 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state active and task_state rescuing.
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:21 user nova-compute[70375]: WARNING nova.compute.manager [req-c2a60224-3755-402a-9bd8-84ad290e644b req-0c97dec6-be63-4c32-aced-eeb6aaf5a478 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state building and task_state spawning.
Jul 24 17:52:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance destroyed successfully.
Jul 24 17:52:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Attempting rescue
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 17:52:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Creating image(s)
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'trusted_certs' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue" returned: 0 in 0.060s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start _get_guest_xml network_info=[{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:6e:aa:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'numa_topology' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:21 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:21 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:52:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'vcpu_model' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1968919247',display_name='tempest-ServerRescueNegativeTestJSON-server-1968919247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1968919247',id=2,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-teimgbjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:47:44Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=be9aa713-99fd-4e4a-a5bb-50f30de8b7ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:6e:aa:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:6e:aa:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:52:22 user nova-compute[70375]:   <uuid>be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</uuid>
Jul 24 17:52:22 user nova-compute[70375]:   <name>instance-00000002</name>
Jul 24 17:52:22 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:52:22 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:52:22 user nova-compute[70375]:   <metadata>
Jul 24 17:52:22 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:52:22 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1968919247</nova:name>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:52:21</nova:creationTime>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:52:22 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:52:22 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:owner>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:52:22 user nova-compute[70375]:       </nova:owner>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:52:22 user nova-compute[70375]:       <nova:ports>
Jul 24 17:52:22 user nova-compute[70375]:         <nova:port uuid="0e8525b5-b749-40ef-a718-06cb77902a2f">
Jul 24 17:52:22 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:52:22 user nova-compute[70375]:         </nova:port>
Jul 24 17:52:22 user nova-compute[70375]:       </nova:ports>
Jul 24 17:52:22 user nova-compute[70375]:     </nova:instance>
Jul 24 17:52:22 user nova-compute[70375]:   </metadata>
Jul 24 17:52:22 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:52:22 user nova-compute[70375]:     <system>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="serial">be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</entry>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="uuid">be9aa713-99fd-4e4a-a5bb-50f30de8b7ae</entry>
Jul 24 17:52:22 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:52:22 user nova-compute[70375]:     </system>
Jul 24 17:52:22 user nova-compute[70375]:   </sysinfo>
Jul 24 17:52:22 user nova-compute[70375]:   <os>
Jul 24 17:52:22 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:52:22 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:52:22 user nova-compute[70375]:   </os>
Jul 24 17:52:22 user nova-compute[70375]:   <features>
Jul 24 17:52:22 user nova-compute[70375]:     <acpi/>
Jul 24 17:52:22 user nova-compute[70375]:     <apic/>
Jul 24 17:52:22 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:52:22 user nova-compute[70375]:   </features>
Jul 24 17:52:22 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:52:22 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:52:22 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:52:22 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:52:22 user nova-compute[70375]:   </clock>
Jul 24 17:52:22 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:52:22 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:52:22 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:52:22 user nova-compute[70375]:   </cpu>
Jul 24 17:52:22 user nova-compute[70375]:   <devices>
Jul 24 17:52:22 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:52:22 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:52:22 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue"/>
Jul 24 17:52:22 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:52:22 user nova-compute[70375]:     </disk>
Jul 24 17:52:22 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:52:22 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:52:22 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk"/>
Jul 24 17:52:22 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:52:22 user nova-compute[70375]:     </disk>
Jul 24 17:52:22 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:52:22 user nova-compute[70375]:       <mac address="fa:16:3e:6e:aa:fc"/>
Jul 24 17:52:22 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:22 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:52:22 user nova-compute[70375]:       <target dev="tap0e8525b5-b7"/>
Jul 24 17:52:22 user nova-compute[70375]:     </interface>
Jul 24 17:52:22 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:52:22 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/console.log" append="off"/>
Jul 24 17:52:22 user nova-compute[70375]:     </serial>
Jul 24 17:52:22 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:52:22 user nova-compute[70375]:     <video>
Jul 24 17:52:22 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:52:22 user nova-compute[70375]:     </video>
Jul 24 17:52:22 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:52:22 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:52:22 user nova-compute[70375]:     </rng>
Jul 24 17:52:22 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:52:22 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:52:22 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:52:22 user nova-compute[70375]:     </memballoon>
Jul 24 17:52:22 user nova-compute[70375]:   </devices>
Jul 24 17:52:22 user nova-compute[70375]: </domain>
Jul 24 17:52:22 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:52:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance destroyed successfully.
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:6e:aa:fc, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:22 user nova-compute[70375]: WARNING nova.compute.manager [req-9efa8edb-991f-40a9-988d-4b19cc5ae26b req-a5bb480d-2772-482a-93da-6fd9face7710 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state active and task_state rescuing.
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:23 user nova-compute[70375]: WARNING nova.compute.manager [req-02c3a2c2-d842-47b8-965d-bf96d95ed7f4 req-00edbde9-b1ad-43c3-8034-079efbd6f940 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state building and task_state spawning.
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221143.8849876, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Resumed (Lifecycle Event)
Jul 24 17:52:23 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance spawned successfully.
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:52:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221143.8851018, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Started (Lifecycle Event)
Jul 24 17:52:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:52:24 user nova-compute[70375]: INFO nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Took 7.27 seconds to spawn the instance on the hypervisor.
Jul 24 17:52:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:24 user nova-compute[70375]: INFO nova.compute.manager [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Took 8.18 seconds to build instance.
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1bba6ea-05b8-4426-bf6f-9ad880960b97 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.288s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:24 user nova-compute[70375]: WARNING nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state active and task_state rescuing.
Jul 24 17:52:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:24 user nova-compute[70375]: WARNING nova.compute.manager [req-7c9236d1-5c6d-4807-802a-54d1c518ab64 req-dc5eecf8-cdcc-42d0-926a-af4c432a5882 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state active and task_state rescuing.
Jul 24 17:52:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for be9aa713-99fd-4e4a-a5bb-50f30de8b7ae due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221146.329578, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Resumed (Lifecycle Event)
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-eb0a0538-9a0c-4a39-8c9e-cc7b7deeaed2 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221146.3325725, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:52:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Started (Lifecycle Event)
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:52:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:52:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:52:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: INFO nova.compute.manager [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Detaching volume b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:52:36 user nova-compute[70375]: INFO nova.virt.block_device [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Attempting to driver detach volume b75085e2-d522-4114-85d4-4e9eb71a0d74 from mountpoint /dev/vdb
Jul 24 17:52:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Attempting to detach device vdb from instance a32f2c47-1d35-4436-9da4-7c94de7ed79c from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:52:36 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:52:36 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:52:36 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:52:36 user nova-compute[70375]:   <serial>b75085e2-d522-4114-85d4-4e9eb71a0d74</serial>
Jul 24 17:52:36 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:52:36 user nova-compute[70375]: </disk>
Jul 24 17:52:36 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance a32f2c47-1d35-4436-9da4-7c94de7ed79c from the persistent domain config.
Jul 24 17:52:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a32f2c47-1d35-4436-9da4-7c94de7ed79c from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:52:36 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:52:36 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:52:36 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:52:36 user nova-compute[70375]:   <serial>b75085e2-d522-4114-85d4-4e9eb71a0d74</serial>
Jul 24 17:52:36 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:52:36 user nova-compute[70375]: </disk>
Jul 24 17:52:36 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221157.0988712, a32f2c47-1d35-4436-9da4-7c94de7ed79c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance a32f2c47-1d35-4436-9da4-7c94de7ed79c from the live domain config.
Jul 24 17:52:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJYuUtnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:52:37 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaac6ef-16cd-4ff9-b6b2-b6564e3e3136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:52:37 user nova-compute[70375]: No targets found.
Jul 24 17:52:37 user nova-compute[70375]: iSNS:
Jul 24 17:52:37 user nova-compute[70375]: No targets found.
Jul 24 17:52:37 user nova-compute[70375]: STATIC:
Jul 24 17:52:37 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74
Jul 24 17:52:37 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:52:37 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:52:37 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:52:37 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:52:37 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:52:37 user nova-compute[70375]: FIRMWARE:
Jul 24 17:52:37 user nova-compute[70375]: No targets found.
Jul 24 17:52:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:52:37 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:52:37 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2ff689-40d6-451c-b72d-1b070de4bd80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1ee18-c8a9-425c-9339-050353282c07]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:52:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:52:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:52:37 user nova-compute[70375]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 (non-flash)
Jul 24 17:52:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6502b6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef7d99-9022-45a4-b258-9b21bf43902c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3752746a-8a37-4d57-92ff-85ea4546f589]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac50cf6-bbaa-4abb-8dd4-d187076fa096]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b5cf51-5da7-41b2-b54d-c9d739639345]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f98232-3ef7-4af4-bf7c-290d33780862]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3c3d4-fc30-4579-b991-dc91709677e2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260]
Jul 24 17:52:37 user nova-compute[70375]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74, portal: 172.16.0.220,3260] successful.
Jul 24 17:52:37 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75085e2-d522-4114-85d4-4e9eb71a0d74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7b534c-4482-4b3b-9c31-2ecba1e07ca1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== disconnect_volume: return (468ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:52:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e659138-d672-4713-9d7f-01815d51a38f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.647s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=24.489456176757812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Applying migration context for instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 as it has an incoming, in-progress migration e5f97bff-099a-473d-b0c0-0a81837a4346. Migration status is finished {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 17:52:39 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating resource usage from migration e5f97bff-099a-473d-b0c0-0a81837a4346
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a32f2c47-1d35-4436-9da4-7c94de7ed79c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 23c835be-30a5-4353-ac0a-dca4c53e7921 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Migration e5f97bff-099a-473d-b0c0-0a81837a4346 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:52:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:48 user nova-compute[70375]: INFO nova.compute.manager [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Terminating instance
Jul 24 17:52:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-unplugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] No waiting events found dispatching network-vif-unplugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-09078e9f-0d9f-4bd7-8d6a-954d12b3d6cc req-823dbc3d-83bb-4a1f-a300-da8df5b00481 service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-unplugged-fba13bd2-e46f-40e4-bb80-1380bc67687d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Instance destroyed successfully.
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lazy-loading 'resources' on Instance uuid 23c835be-30a5-4353-ac0a-dca4c53e7921 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1173480197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1173480',id=12,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+mf4MojBWbx7ndQUqWJiOqyxKTJ0i/MARuffrrP6deCbGyYPBV1Knp2xLIoTZkuys68QPZJQj0tyabqCZLnwJ2Gclu/zA1hjTodLRy2cNwr0KAQ7f7lZXcHSUTZEAmEQ==',key_name='tempest-keypair-545366782',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddac964fe7c5486d9a6b009e20de7890',ramdisk_id='',reservation_id='r-3evkzdyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7073c1a99c94606a7056d1ccf31c5cc',uuid=23c835be-30a5-4353-ac0a-dca4c53e7921,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converting VIF {"id": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "address": "fa:16:3e:56:83:5a", "network": {"id": "4ecb5175-ccc9-47f1-9417-7a1c118adde8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1090232841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddac964fe7c5486d9a6b009e20de7890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba13bd2-e4", "ovs_interfaceid": "fba13bd2-e46f-40e4-bb80-1380bc67687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:52:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG os_vif [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfba13bd2-e4, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:50 user nova-compute[70375]: INFO os_vif [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:83:5a,bridge_name='br-int',has_traffic_filtering=True,id=fba13bd2-e46f-40e4-bb80-1380bc67687d,network=Network(4ecb5175-ccc9-47f1-9417-7a1c118adde8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba13bd2-e4')
Jul 24 17:52:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Deleting instance files /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921_del
Jul 24 17:52:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Deletion of /opt/stack/data/nova/instances/23c835be-30a5-4353-ac0a-dca4c53e7921_del complete
Jul 24 17:52:50 user nova-compute[70375]: INFO nova.compute.manager [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 24 17:52:50 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:52:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] Acquiring lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] No waiting events found dispatching network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:52:51 user nova-compute[70375]: WARNING nova.compute.manager [req-e61eaaa4-f126-4fcd-9daf-635bf574e40b req-eb124083-22f1-4ea0-bd52-d74f6f7caace service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received unexpected event network-vif-plugged-fba13bd2-e46f-40e4-bb80-1380bc67687d for instance with vm_state active and task_state deleting.
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:52:51 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Took 1.50 seconds to deallocate network for instance.
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-30ac7417-9990-44d6-981d-ce618ac1ffa4 req-901d7270-ec19-4116-b72b-9dbf4b10c48b service nova] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Received event network-vif-deleted-fba13bd2-e46f-40e4-bb80-1380bc67687d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:52:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:51 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Deleted allocations for instance 23c835be-30a5-4353-ac0a-dca4c53e7921
Jul 24 17:52:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d93d5e0e-7d0d-4a40-a784-de6a273c03f3 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516 tempest-TestServerVolumeAttachScenarioOldVersion-2086663516-project-member] Lock "23c835be-30a5-4353-ac0a-dca4c53e7921" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.353s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:52:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:52:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:52:59 user nova-compute[70375]: INFO nova.compute.claims [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Claim successful on node user
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:53:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:53:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.policy [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a249d8642e364aa09f5d9e5578a30567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941f5e68e0c44a5f890f0901df3b71b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:53:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Creating image(s)
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "/opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "/opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk 1073741824" returned: 0 in 0.087s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Successfully created port: 7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Cannot resize image /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'migration_context' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Ensure instance console log exists: /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Successfully updated port: 7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquired lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-changed-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Refreshing instance network info cache due to event network-changed-7c8aa519-69aa-427f-897e-70b8970668b3. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] Acquiring lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updating instance_info_cache with network_info: [{"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Releasing lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Instance network_info: |[{"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] Acquired lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Refreshing network info cache for port 7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Start _get_guest_xml network_info=[{"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:53:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9728462',display_name='tempest-VolumesSnapshotTestJSON-instance-9728462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9728462',id=17,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1aVaWl2UvmcCXSCVSuwwax5jWpQX78ITUxfU0izra8yGeUg1yVblGHbnUOfv611Xw/sjRKHg12hsvq4y7J/d9ltm2kSYKjliZO/A5mx5EA47rRBJShIYOdxYL3bLwFsg==',key_name='tempest-keypair-1509136975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-1ya1zsfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=f9510c63-82f2-4055-abf6-3de637e27309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'pci_devices' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:53:02 user nova-compute[70375]:   <uuid>f9510c63-82f2-4055-abf6-3de637e27309</uuid>
Jul 24 17:53:02 user nova-compute[70375]:   <name>instance-00000011</name>
Jul 24 17:53:02 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:53:02 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:53:02 user nova-compute[70375]:   <metadata>
Jul 24 17:53:02 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:53:02 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-9728462</nova:name>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:53:02</nova:creationTime>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:53:02 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:53:02 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:owner>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:user uuid="a249d8642e364aa09f5d9e5578a30567">tempest-VolumesSnapshotTestJSON-2081775558-project-member</nova:user>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:project uuid="941f5e68e0c44a5f890f0901df3b71b6">tempest-VolumesSnapshotTestJSON-2081775558</nova:project>
Jul 24 17:53:02 user nova-compute[70375]:       </nova:owner>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:53:02 user nova-compute[70375]:       <nova:ports>
Jul 24 17:53:02 user nova-compute[70375]:         <nova:port uuid="7c8aa519-69aa-427f-897e-70b8970668b3">
Jul 24 17:53:02 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:53:02 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:02 user nova-compute[70375]:       </nova:ports>
Jul 24 17:53:02 user nova-compute[70375]:     </nova:instance>
Jul 24 17:53:02 user nova-compute[70375]:   </metadata>
Jul 24 17:53:02 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:53:02 user nova-compute[70375]:     <system>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="serial">f9510c63-82f2-4055-abf6-3de637e27309</entry>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="uuid">f9510c63-82f2-4055-abf6-3de637e27309</entry>
Jul 24 17:53:02 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:53:02 user nova-compute[70375]:     </system>
Jul 24 17:53:02 user nova-compute[70375]:   </sysinfo>
Jul 24 17:53:02 user nova-compute[70375]:   <os>
Jul 24 17:53:02 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:53:02 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:53:02 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:53:02 user nova-compute[70375]:   </os>
Jul 24 17:53:02 user nova-compute[70375]:   <features>
Jul 24 17:53:02 user nova-compute[70375]:     <acpi/>
Jul 24 17:53:02 user nova-compute[70375]:     <apic/>
Jul 24 17:53:02 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:53:02 user nova-compute[70375]:   </features>
Jul 24 17:53:02 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:53:02 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:53:02 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:53:02 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:53:02 user nova-compute[70375]:   </clock>
Jul 24 17:53:02 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:53:02 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:53:02 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:53:02 user nova-compute[70375]:   </cpu>
Jul 24 17:53:02 user nova-compute[70375]:   <devices>
Jul 24 17:53:02 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:53:02 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:53:02 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk"/>
Jul 24 17:53:02 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:53:02 user nova-compute[70375]:     </disk>
Jul 24 17:53:02 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:02 user nova-compute[70375]:       <mac address="fa:16:3e:03:f9:45"/>
Jul 24 17:53:02 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:02 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:02 user nova-compute[70375]:       <target dev="tap7c8aa519-69"/>
Jul 24 17:53:02 user nova-compute[70375]:     </interface>
Jul 24 17:53:02 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:53:02 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/console.log" append="off"/>
Jul 24 17:53:02 user nova-compute[70375]:     </serial>
Jul 24 17:53:02 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:53:02 user nova-compute[70375]:     <video>
Jul 24 17:53:02 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:02 user nova-compute[70375]:     </video>
Jul 24 17:53:02 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:53:02 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:53:02 user nova-compute[70375]:     </rng>
Jul 24 17:53:02 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:53:02 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:53:02 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:53:02 user nova-compute[70375]:     </memballoon>
Jul 24 17:53:02 user nova-compute[70375]:   </devices>
Jul 24 17:53:02 user nova-compute[70375]: </domain>
Jul 24 17:53:02 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9728462',display_name='tempest-VolumesSnapshotTestJSON-instance-9728462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9728462',id=17,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1aVaWl2UvmcCXSCVSuwwax5jWpQX78ITUxfU0izra8yGeUg1yVblGHbnUOfv611Xw/sjRKHg12hsvq4y7J/d9ltm2kSYKjliZO/A5mx5EA47rRBJShIYOdxYL3bLwFsg==',key_name='tempest-keypair-1509136975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-1ya1zsfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=f9510c63-82f2-4055-abf6-3de637e27309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG os_vif [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c8aa519-69, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c8aa519-69, col_values=(('external_ids', {'iface-id': '7c8aa519-69aa-427f-897e-70b8970668b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f9:45', 'vm-uuid': 'f9510c63-82f2-4055-abf6-3de637e27309'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:02 user nova-compute[70375]: INFO os_vif [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69')
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:53:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No VIF found with MAC fa:16:3e:03:f9:45, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updated VIF entry in instance network info cache for port 7c8aa519-69aa-427f-897e-70b8970668b3. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updating instance_info_cache with network_info: [{"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cee5db6-e5c7-4895-bcf5-1cbd1376f84d req-6f8d43b7-6c04-4af4-8c07-3ea0eff2c868 service nova] Releasing lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221169.5435395, 23c835be-30a5-4353-ac0a-dca4c53e7921 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:04 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] VM Stopped (Lifecycle Event)
Jul 24 17:53:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7bebe831-3c0b-4448-a671-15d256e37c62 None None] [instance: 23c835be-30a5-4353-ac0a-dca4c53e7921] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] No waiting events found dispatching network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:04 user nova-compute[70375]: WARNING nova.compute.manager [req-5a4035d4-431e-4d0a-a048-fa9b67068316 req-d19a22e4-8d33-44bb-a507-03f71770952d service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received unexpected event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 for instance with vm_state building and task_state spawning.
Jul 24 17:53:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221186.208116, f9510c63-82f2-4055-abf6-3de637e27309 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] VM Resumed (Lifecycle Event)
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Instance spawned successfully.
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221186.2163827, f9510c63-82f2-4055-abf6-3de637e27309 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] VM Started (Lifecycle Event)
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Took 5.80 seconds to spawn the instance on the hypervisor.
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:06 user nova-compute[70375]: INFO nova.compute.manager [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Took 6.59 seconds to build instance.
Jul 24 17:53:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11fd749d-6fb8-4486-a876-1c4fbd08e353 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.686s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] No waiting events found dispatching network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:06 user nova-compute[70375]: WARNING nova.compute.manager [req-243e9ea4-b76a-40ff-950e-91a5862506e0 req-b1db0cbb-1524-47d3-b413-251e02e9ec16 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received unexpected event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 for instance with vm_state active and task_state None.
Jul 24 17:53:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:10 user nova-compute[70375]: INFO nova.compute.manager [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Terminating instance
Jul 24 17:53:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-unplugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-unplugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-50ca5fa0-8ff0-4641-bdec-30537fcfb63d req-9ba732d1-2cbd-4bf4-aad2-ec29a6cc0c09 service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-unplugged-08ffec72-e834-4552-928c-234778f5c816 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Instance destroyed successfully.
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'resources' on Instance uuid ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1054706891',display_name='tempest-VolumesAdminNegativeTest-server-1054706891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1054706891',id=14,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:51:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-g7zu7boe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:51:17Z,user_data=None,user_id='489f6bd0397e442f8967b992adc9a998',uuid=ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "08ffec72-e834-4552-928c-234778f5c816", "address": "fa:16:3e:28:eb:9b", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ffec72-e8", "ovs_interfaceid": "08ffec72-e834-4552-928c-234778f5c816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG os_vif [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08ffec72-e8, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:11 user nova-compute[70375]: INFO os_vif [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:eb:9b,bridge_name='br-int',has_traffic_filtering=True,id=08ffec72-e834-4552-928c-234778f5c816,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ffec72-e8')
Jul 24 17:53:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Deleting instance files /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc_del
Jul 24 17:53:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Deletion of /opt/stack/data/nova/instances/ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc_del complete
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: INFO nova.compute.manager [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 24 17:53:11 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:12 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Took 0.75 seconds to deallocate network for instance.
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Deleted allocations for instance ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ef633b15-ac60-4157-8cc2-9ec2542f2525 tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:12 user nova-compute[70375]: WARNING nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state deleted and task_state None.
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:12 user nova-compute[70375]: WARNING nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state deleted and task_state None.
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:12 user nova-compute[70375]: WARNING nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state deleted and task_state None.
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Acquiring lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] Lock "ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] No waiting events found dispatching network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:12 user nova-compute[70375]: WARNING nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received unexpected event network-vif-plugged-08ffec72-e834-4552-928c-234778f5c816 for instance with vm_state deleted and task_state None.
Jul 24 17:53:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f200d76f-3fba-4950-be0c-425ff92eaccc req-3ebb9197-e209-4a9c-b354-9d41fd28fafb service nova] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Received event network-vif-deleted-08ffec72-e834-4552-928c-234778f5c816 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating instance_info_cache with network_info: [{"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-06592a39-04a0-4e73-bb76-546a29fedab3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 17:53:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221191.1523774, ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:26 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] VM Stopped (Lifecycle Event)
Jul 24 17:53:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5df20122-e81a-4d35-a1e3-375d2a0adc3b None None] [instance: ae67b06e-9b74-4ab1-9c1d-f5d19ecdafbc] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:26 user nova-compute[70375]: INFO nova.compute.manager [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Terminating instance
Jul 24 17:53:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-unplugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] No waiting events found dispatching network-vif-unplugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-c8272b0e-a61d-4659-bdfc-52e164f86fff req-ac54fa8d-b012-44a8-b5be-9d21239999a3 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-unplugged-7a90f720-81a5-4c3f-8127-09c271d8d51b for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Instance destroyed successfully.
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'resources' on Instance uuid a32f2c47-1d35-4436-9da4-7c94de7ed79c {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1134374557',display_name='tempest-AttachVolumeNegativeTest-server-1134374557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1134374557',id=4,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiKFaKYMvLVjldHiQbJqHjRFX2RR8J/AyftFdh0Ad9oSORy/uM1pMYbXWXOdlam42cBJGsIhk2b4xg61SiZo70LnCHcFJGHDhSgrCfiDMaxOAL1k6sI0qA8lhu0KtgZyA==',key_name='tempest-keypair-1840823664',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:47:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-r85czy0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=a32f2c47-1d35-4436-9da4-7c94de7ed79c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "address": "fa:16:3e:f5:ad:80", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a90f720-81", "ovs_interfaceid": "7a90f720-81a5-4c3f-8127-09c271d8d51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG os_vif [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a90f720-81, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:27 user nova-compute[70375]: INFO os_vif [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ad:80,bridge_name='br-int',has_traffic_filtering=True,id=7a90f720-81a5-4c3f-8127-09c271d8d51b,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a90f720-81')
Jul 24 17:53:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Deleting instance files /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c_del
Jul 24 17:53:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Deletion of /opt/stack/data/nova/instances/a32f2c47-1d35-4436-9da4-7c94de7ed79c_del complete
Jul 24 17:53:27 user nova-compute[70375]: INFO nova.compute.manager [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 17:53:27 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:53:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:53:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 17:53:28 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:28 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Took 0.92 seconds to deallocate network for instance.
Jul 24 17:53:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:29 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Deleted allocations for instance a32f2c47-1d35-4436-9da4-7c94de7ed79c
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7e188634-08b5-4244-897a-b734804f4bf5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] Acquiring lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] Lock "a32f2c47-1d35-4436-9da4-7c94de7ed79c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] No waiting events found dispatching network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:29 user nova-compute[70375]: WARNING nova.compute.manager [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received unexpected event network-vif-plugged-7a90f720-81a5-4c3f-8127-09c271d8d51b for instance with vm_state deleted and task_state None.
Jul 24 17:53:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7204457-13ec-4e8f-a823-e7960796aab2 req-108f507e-5e61-4e97-af09-d71e0e75b174 service nova] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Received event network-vif-deleted-7a90f720-81a5-4c3f-8127-09c271d8d51b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:53:31 user nova-compute[70375]: INFO nova.compute.claims [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Claim successful on node user
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:53:32 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:32 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:32 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=24.488418579101562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:53:32 user nova-compute[70375]: INFO nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Booting with volume 667aaf05-a6da-453d-982d-4630d6c39df0 at /dev/vda
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Applying migration context for instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 as it has an incoming, in-progress migration e5f97bff-099a-473d-b0c0-0a81837a4346. Migration status is reverting {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 17:53:32 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating resource usage from migration e5f97bff-099a-473d-b0c0-0a81837a4346
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.policy [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e5e89ecdce7447397bc313eb057251d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695cd522a9364c03979befc8c8ded313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7692e55-c67d-4472-8b12-70e8e48dcb3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 06592a39-04a0-4e73-bb76-546a29fedab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Migration e5f97bff-099a-473d-b0c0-0a81837a4346 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f9510c63-82f2-4055-abf6-3de637e27309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Port 68b0448f-d9ad-4486-9db5-9d9f1f626cae binding to destination host user is already ACTIVE {{(pid=70375) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c4a47-05a0-4d61-8102-4501c40ddcae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75afa47-361f-4d26-a83b-94d192a2ee53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bad998-5164-4f45-8834-1808ba2bab28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:33 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f6123-95dd-48b8-8fe9-f7fa1fe603d3]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating existing volume attachment record: 939ae57b-0c76-4247-9b17-fa480b946653 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Creating tmpfile /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/tmp0pbeu0fp to verify with other compute node that the instance is on the same shared storage. {{(pid=70375) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully created port: 04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:33 user nova-compute[70375]: WARNING nova.compute.manager [req-9937e018-6b12-4e23-b485-641fb7da084d req-5017edf7-afff-4a77-9ea5-9d2392f8ee3f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state resized and task_state resize_reverting.
Jul 24 17:53:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance destroyed successfully.
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'resources' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b0448f-d9, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:34 user nova-compute[70375]: INFO os_vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:34 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667d458-2a9b-4384-8a09-093c1c61760e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:53:34 user nova-compute[70375]: No targets found.
Jul 24 17:53:34 user nova-compute[70375]: iSNS:
Jul 24 17:53:34 user nova-compute[70375]: No targets found.
Jul 24 17:53:34 user nova-compute[70375]: STATIC:
Jul 24 17:53:34 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:53:34 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:53:34 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:53:34 user nova-compute[70375]: FIRMWARE:
Jul 24 17:53:34 user nova-compute[70375]: No targets found.
Jul 24 17:53:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:53:34 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:53:34 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully created port: cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04bc57-e45f-4762-b53f-8343b42fab17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[41087763-bdba-412e-be1b-3f339168af43]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6481797e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f67073a-55df-401e-b4fe-f3ca8c0bdcbf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4285e45-d9b8-4ac8-8321-640b0b255900]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb27b945-7cee-4f67-a4dc-c38e066642a2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907a5da-52a6-4d02-96a2-8f4a459eeb0c]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d895e1ed-6464-4a40-bed0-e283ecf09cca]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee94a94-a15b-4a57-a7fd-74ea7c248565]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:53:34 user nova-compute[70375]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:53:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb7daa6-583b-4970-bbac-716f55a427bc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== disconnect_volume: return (293ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully created port: 22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:35 user nova-compute[70375]: WARNING nova.compute.manager [req-fafc6230-db50-4fd6-87be-70ff47c08652 req-a154a174-afe2-4c26-bf9f-3fd56149d5bb service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state resized and task_state resize_reverting.
Jul 24 17:53:35 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully created port: e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully created port: 66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'migration_context' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.386s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: 04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-04ddbcba-2231-47d5-bf3e-7e82a728169e. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.network.neutron [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:37 user nova-compute[70375]: INFO nova.compute.manager [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Swapping old allocation on dict_keys(['111dfe89-23fd-4eb8-8c78-beab50e50b4c']) held by migration e5f97bff-099a-473d-b0c0-0a81837a4346 for instance
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Overwriting current allocation {'allocations': {'111dfe89-23fd-4eb8-8c78-beab50e50b4c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'a79f1241a80f4fe498df5e46217254d1', 'user_id': '49c33bc394214fa1a864e79cdef00465', 'consumer_generation': 1} on consumer 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 24 17:53:37 user nova-compute[70375]: DEBUG nova.network.neutron [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquired lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG nova.network.neutron [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f5a7334a-a050-4d74-97b3-40d1b0e89eed req-0d357765-8fcf-44b6-9fc2-5f7cfc373215 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Releasing lock "refresh_cache-81fd89d8-c2b9-4398-83f5-0ddb45f14722" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.utils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a689025-a789-4405-a4f4-6d363faaaa24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ea978-57e9-4916-87d4-809c741f3371]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: 37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[956afee0-d012-4759-927c-b8c1e7ecd6cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d402ac85-be79-4230-b138-dfaddbcb8cb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:39 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e0556-f811-406f-a8ee-1dd974c2192d]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG os_brick.utils [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-37599ee2-d38d-495a-86c3-42c5663a2bb8. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: 7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:40 user nova-compute[70375]: INFO nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Booting with volume a63a7b15-4bfb-4a3e-898a-c25c1949e59c at /dev/vdb
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e87707e-5eca-48e1-9ded-e6460eb30fae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c4fb91-b917-4cad-909c-257116ca65fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98de17f-bc82-4891-a96e-63370a49eb53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea152f-0bf7-4209-9531-804e68628b8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d7dcb51-1aad-47fa-af38-48b0723a3ed5 req-848c69e1-761b-47c5-95e8-80d4114d50df service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:40 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:53:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc62b895-33b6-4579-9d61-00d7509da5c0]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:40 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating existing volume attachment record: 48c0bdcf-73c6-428e-a6fe-88afee93fdd9 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: 22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-7e8f0011-a379-4605-b74a-febf1e0ad798. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:41 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221207.5854445, a32f2c47-1d35-4436-9da4-7c94de7ed79c => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:42 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] VM Stopped (Lifecycle Event)
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6fa925b1-fa8b-4659-88cb-e49d0d4f68a4 None None] [instance: a32f2c47-1d35-4436-9da4-7c94de7ed79c] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-cbb84c41-2bd6-41d0-ae43-13324a6503d9. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-22f8211e-1dbd-451f-994d-cf2a32825495. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-efa429e9-d4e7-4496-a25b-dac322b270ce req-8baf4382-a56c-47ca-886a-353163e36b73 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-e81a213a-7fa4-495f-9e06-ad06e4e61973. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-29e30ea2-ddc3-4c99-b9a6-7497e63b63db req-aeb81872-350a-40ef-a62e-9fcdc1b7b51f service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Successfully updated port: 66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:53:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-66ba626e-9419-4b79-9653-c3c1d3e38bcb. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Starting finish_revert_migration {{(pid=70375) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start _get_guest_xml network_info=[{"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ca637ce-3890-4ff1-a4d5-3f20733493fe', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '81fd89d8-c2b9-4398-83f5-0ddb45f14722', 'attached_at': '2023-07-24T17:53:46.000000', 'detached_at': '', 'volume_id': '83d1e070-72bc-4042-a555-39471203d2f8', 'serial': '83d1e070-72bc-4042-a555-39471203d2f8'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:53:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:46 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8534236-2c60-48ea-ab59-9424192ce0ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:53:46 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14bb989-c167-40fa-a5a7-398811ed0144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8] added
Jul 24 17:53:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87f611-fa65-4931-a84f-6e1db9d1efbd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[340efbe0-6ca7-429f-8e54-6354e527b113]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FhbMZjpy" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[392aacf5-7c19-4c63-9a65-30c69d775476]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FhbMZjpy'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b7574-ea4e-43e5-95dd-6a756968ecac]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b89406-7f99-47a5-b640-46245f1e84a8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:53:46 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:53:46 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 17:53:46 user nova-compute[70375]: 
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739bedf-0c2a-4dcc-97fa-bc5e9f4933bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:53:46 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:53:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c637f8c7-0ee0-4ab2-bdba-3cb171f30ee8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098be68-fffb-475b-aa24-ed1a9a81ace4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189927e-affc-4eca-ab14-887a9a21b65d]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:53:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.neutron [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance network_info: |[{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:47 user nova-compute[70375]: INFO nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Booting with volume eff0f79b-315a-47d5-9224-395b233314f3 at /dev/vdc
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cab46b6-91b7-4629-90fe-7f7e73e30fd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f4009e-afff-42df-a144-fdf4abb63256]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e704b2-eb73-47c2-aec7-aaff94f018bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beb3e0d-db4f-4bb6-ac37-20ffca28081c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:53:47 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6da0cb-f2c6-47a4-bb98-748a61bcb94d]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.utils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating existing volume attachment record: fb519abf-0246-4681-844f-6611dc9dd6eb {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323266643561', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updated VIF entry in instance network info cache for port 66ba626e-9419-4b79-9653-c3c1d3e38bcb. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7dda4b-ed81-4278-8403-a4899570117b req-29b367a3-b938-493c-87ac-1e0091ef9de8 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:53:47 user nova-compute[70375]:   <uuid>81fd89d8-c2b9-4398-83f5-0ddb45f14722</uuid>
Jul 24 17:53:47 user nova-compute[70375]:   <name>instance-00000005</name>
Jul 24 17:53:47 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:53:47 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:53:47 user nova-compute[70375]:   <metadata>
Jul 24 17:53:47 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:53:47 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherB-server-358915896</nova:name>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:53:46</nova:creationTime>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:53:47 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:53:47 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:owner>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:user uuid="49c33bc394214fa1a864e79cdef00465">tempest-ServerActionsTestOtherB-1934690611-project-member</nova:user>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:project uuid="a79f1241a80f4fe498df5e46217254d1">tempest-ServerActionsTestOtherB-1934690611</nova:project>
Jul 24 17:53:47 user nova-compute[70375]:       </nova:owner>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:53:47 user nova-compute[70375]:       <nova:ports>
Jul 24 17:53:47 user nova-compute[70375]:         <nova:port uuid="68b0448f-d9ad-4486-9db5-9d9f1f626cae">
Jul 24 17:53:47 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:53:47 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:47 user nova-compute[70375]:       </nova:ports>
Jul 24 17:53:47 user nova-compute[70375]:     </nova:instance>
Jul 24 17:53:47 user nova-compute[70375]:   </metadata>
Jul 24 17:53:47 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:53:47 user nova-compute[70375]:     <system>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="serial">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="uuid">81fd89d8-c2b9-4398-83f5-0ddb45f14722</entry>
Jul 24 17:53:47 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:53:47 user nova-compute[70375]:     </system>
Jul 24 17:53:47 user nova-compute[70375]:   </sysinfo>
Jul 24 17:53:47 user nova-compute[70375]:   <os>
Jul 24 17:53:47 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:53:47 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:53:47 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:53:47 user nova-compute[70375]:   </os>
Jul 24 17:53:47 user nova-compute[70375]:   <features>
Jul 24 17:53:47 user nova-compute[70375]:     <acpi/>
Jul 24 17:53:47 user nova-compute[70375]:     <apic/>
Jul 24 17:53:47 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:53:47 user nova-compute[70375]:   </features>
Jul 24 17:53:47 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:53:47 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:53:47 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:53:47 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:53:47 user nova-compute[70375]:   </clock>
Jul 24 17:53:47 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:53:47 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:53:47 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:53:47 user nova-compute[70375]:   </cpu>
Jul 24 17:53:47 user nova-compute[70375]:   <devices>
Jul 24 17:53:47 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:53:47 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:53:47 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk"/>
Jul 24 17:53:47 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:53:47 user nova-compute[70375]:     </disk>
Jul 24 17:53:47 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:53:47 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:53:47 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 17:53:47 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:53:47 user nova-compute[70375]:       <serial>83d1e070-72bc-4042-a555-39471203d2f8</serial>
Jul 24 17:53:47 user nova-compute[70375]:     </disk>
Jul 24 17:53:47 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:47 user nova-compute[70375]:       <mac address="fa:16:3e:4d:88:af"/>
Jul 24 17:53:47 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:47 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:47 user nova-compute[70375]:       <target dev="tap68b0448f-d9"/>
Jul 24 17:53:47 user nova-compute[70375]:     </interface>
Jul 24 17:53:47 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:53:47 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/console.log" append="off"/>
Jul 24 17:53:47 user nova-compute[70375]:     </serial>
Jul 24 17:53:47 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:53:47 user nova-compute[70375]:     <video>
Jul 24 17:53:47 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:47 user nova-compute[70375]:     </video>
Jul 24 17:53:47 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:53:47 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:53:47 user nova-compute[70375]:     </rng>
Jul 24 17:53:47 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:53:47 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:53:47 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:53:47 user nova-compute[70375]:     </memballoon>
Jul 24 17:53:47 user nova-compute[70375]:   </devices>
Jul 24 17:53:47 user nova-compute[70375]: </domain>
Jul 24 17:53:47 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG os_vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b0448f-d9, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68b0448f-d9, col_values=(('external_ids', {'iface-id': '68b0448f-d9ad-4486-9db5-9d9f1f626cae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:88:af', 'vm-uuid': '81fd89d8-c2b9-4398-83f5-0ddb45f14722'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:47 user nova-compute[70375]: INFO os_vif [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:53:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221214.3762379, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:49 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Stopped (Lifecycle Event)
Jul 24 17:53:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8298b8b7-baa0-413c-af13-77d5e6c09fc6 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:49 user nova-compute[70375]: WARNING nova.compute.manager [req-d016eac0-8878-4feb-a793-e185eb3fdcfe req-06d6b4fe-e520-4588-a6b5-39c0c4024bf7 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state resized and task_state resize_reverting.
Jul 24 17:53:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:53:51 user nova-compute[70375]: WARNING nova.compute.manager [req-95586bb2-fd5a-4d5a-80a3-3e83c88cabed req-5fc6d123-6c20-4d99-9159-961c0cb997a8 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state resized and task_state resize_reverting.
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221231.6651907, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Resumed (Lifecycle Event)
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance running successfully.
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] finish_revert_migration finished successfully. {{(pid=70375) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221231.666829, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Started (Lifecycle Event)
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:53:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 17:53:51 user nova-compute[70375]: INFO nova.compute.manager [None req-2ba1339c-8590-4382-9e3b-28702e6b4294 tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance to original state: 'active'
Jul 24 17:53:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:53:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Creating image(s)
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Start _get_guest_xml network_info=[{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '939ae57b-0c76-4247-9b17-fa480b946653', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYTlHezZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e', 'attached_at': '', 'detached_at': '', 'volume_id': '667aaf05-a6da-453d-982d-4630d6c39df0', 'serial': '667aaf05-a6da-453d-982d-4630d6c39df0'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '48c0bdcf-73c6-428e-a6fe-88afee93fdd9', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwRVurA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 'serial': 'a63a7b15-4bfb-4a3e-898a-c25c1949e59c'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'fb519abf-0246-4681-844f-6611dc9dd6eb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olSZYEGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'eff0f79b-315a-47d5-9224-395b233314f3', 'serial': 'eff0f79b-315a-47d5-9224-395b233314f3'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:53:54 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:54 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:53:54 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYTlHezZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:55 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-changed-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing instance network info cache due to event network-changed-13da2668-5eab-4063-be21-265d9433e5f8. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing network info cache for port 13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6312827-d34f-4b47-9597-1fe61b12860c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:53:55 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b5537-d5aa-4544-9d0a-aa260bbe8887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0] added
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e0905d-a704-45a0-9179-5b5eeaf4dfc1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0631ac94-fee5-437c-a112-2100ff36c278]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYTlHezZ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYTlHezZ" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8bb9cd-42c1-43ba-b2d5-65625a81156b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYTlHezZ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[10feb617-0459-48f0-881e-d28fb3e22f16]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c44a0c-f484-4ba6-834b-0d7ef89c8482]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7e311-6ba4-46c0-b1ed-9163aef061e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260]
Jul 24 17:53:55 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260] successful.
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e137a40b-9c0d-4862-a9ce-daa1eee9bee2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7601f30d-8c96-4bdb-9dba-a6a560b523be]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a81e9f-25ea-4d85-99a1-d770a905fb16]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:53:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updated VIF entry in instance network info cache for port 13da2668-5eab-4063-be21-265d9433e5f8. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-73abbc64-4822-4b05-819a-40680d4dca67 req-e5f972ba-5ba3-48ba-8825-a8d85efa336f service nova] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'pci_requests' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYTlHezZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26636353663636432', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636353663636432', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwRVurA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:56 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:56 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:56 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3895cf-38c3-48b3-9733-c2fc464ca7ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:53:56 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7c750-264a-4cb7-b29c-5f8a847d15d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c] added
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c07f7-e943-4126-87e4-3e79b8fdd630]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c72bf-1ef3-4bdb-87ba-e9d6eff47539]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlwRVurA {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlwRVurA" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ce9a1-d785-49c1-a056-4f166c42a0e2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlwRVurA'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa90a59-3124-47b9-9815-8eb30e13e368]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5007e513-f6d9-4ca4-b158-9b42eac40a00]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc19aa-7729-48b3-80c3-86d32aaef13a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260]
Jul 24 17:53:56 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260] successful.
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d76da-fb2f-46fe-9790-0dc4857f6ca7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e5d77-eb32-497a-9a93-f86e21bf6c79]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:56 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bdaa2-29d3-445a-8ebe-752abcdf7b76]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwRVurA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:53:56 user nova-compute[70375]: DEBUG nova.policy [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fb73acfd51b4e1ea6efb319ce639881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3444fa91ae1a496987218fedaf7b5e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26235623335383837', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235623335383837', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olSZYEGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:53:57 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:57 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:53:57 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc86e09-ba62-4c1b-a059-d46429f8e193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:53:57 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Successfully created port: 459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c42f2-53b0-4861-91ee-147d3671d78a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3] added
Jul 24 17:53:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647065a-5d6d-43a9-ab85-347820eb8df4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b2a312-af3c-4b1f-b2e2-10658c893a2c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olSZYEGJ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olSZYEGJ" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025c9ac-76ae-465a-aa5a-f4d28f335410]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olSZYEGJ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[35984e6c-a66c-411c-b956-d2bc56e96aed]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01827c3-77d3-412b-b76a-e5855feca2a8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:57 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:57 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:57 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:57 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[96854322-e88a-44b0-80c4-28c55dd92016]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260]
Jul 24 17:53:58 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260] successful.
Jul 24 17:53:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa2f709-326a-4d94-a434-83f735eabd97]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e12ef82-237e-49b9-89f2-b33024f95842]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:53:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:53:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768337e-675d-4fb0-8bf8-6f14b89bed8f]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olSZYEGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Successfully updated port: 459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-changed-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing instance network info cache due to event network-changed-459e4526-f733-447c-a196-9ae51825f09d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:53:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26232353863356562', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232353863356562', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lazy-loading 'pci_devices' on Instance uuid e4c27005-3977-475c-ad11-5fd13b9e7a2e {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:53:59 user nova-compute[70375]:   <uuid>e4c27005-3977-475c-ad11-5fd13b9e7a2e</uuid>
Jul 24 17:53:59 user nova-compute[70375]:   <name>instance-00000012</name>
Jul 24 17:53:59 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:53:59 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:53:59 user nova-compute[70375]:   <metadata>
Jul 24 17:53:59 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:53:59 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:name>tempest-device-tagging-server-2001750488</nova:name>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:53:54</nova:creationTime>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:53:59 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:53:59 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:owner>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:user uuid="1e5e89ecdce7447397bc313eb057251d">tempest-TaggedBootDevicesTest-1417328943-project-member</nova:user>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:project uuid="695cd522a9364c03979befc8c8ded313">tempest-TaggedBootDevicesTest-1417328943</nova:project>
Jul 24 17:53:59 user nova-compute[70375]:       </nova:owner>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:53:59 user nova-compute[70375]:       <nova:ports>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="04ddbcba-2231-47d5-bf3e-7e82a728169e">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="37599ee2-d38d-495a-86c3-42c5663a2bb8">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="7e8f0011-a379-4605-b74a-febf1e0ad798">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="cbb84c41-2bd6-41d0-ae43-13324a6503d9">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="22f8211e-1dbd-451f-994d-cf2a32825495">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="e81a213a-7fa4-495f-9e06-ad06e4e61973">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:         <nova:port uuid="66ba626e-9419-4b79-9653-c3c1d3e38bcb">
Jul 24 17:53:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 17:53:59 user nova-compute[70375]:         </nova:port>
Jul 24 17:53:59 user nova-compute[70375]:       </nova:ports>
Jul 24 17:53:59 user nova-compute[70375]:     </nova:instance>
Jul 24 17:53:59 user nova-compute[70375]:   </metadata>
Jul 24 17:53:59 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:53:59 user nova-compute[70375]:     <system>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="serial">e4c27005-3977-475c-ad11-5fd13b9e7a2e</entry>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="uuid">e4c27005-3977-475c-ad11-5fd13b9e7a2e</entry>
Jul 24 17:53:59 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:53:59 user nova-compute[70375]:     </system>
Jul 24 17:53:59 user nova-compute[70375]:   </sysinfo>
Jul 24 17:53:59 user nova-compute[70375]:   <os>
Jul 24 17:53:59 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:53:59 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:53:59 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:53:59 user nova-compute[70375]:   </os>
Jul 24 17:53:59 user nova-compute[70375]:   <features>
Jul 24 17:53:59 user nova-compute[70375]:     <acpi/>
Jul 24 17:53:59 user nova-compute[70375]:     <apic/>
Jul 24 17:53:59 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:53:59 user nova-compute[70375]:   </features>
Jul 24 17:53:59 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:53:59 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:53:59 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:53:59 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:53:59 user nova-compute[70375]:   </clock>
Jul 24 17:53:59 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:53:59 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:53:59 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:53:59 user nova-compute[70375]:   </cpu>
Jul 24 17:53:59 user nova-compute[70375]:   <devices>
Jul 24 17:53:59 user nova-compute[70375]:     <disk type="file" device="cdrom">
Jul 24 17:53:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 17:53:59 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/disk.config"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="hda" bus="ide"/>
Jul 24 17:53:59 user nova-compute[70375]:     </disk>
Jul 24 17:53:59 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:53:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:53:59 user nova-compute[70375]:       <source dev="/dev/sdc"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <serial>667aaf05-a6da-453d-982d-4630d6c39df0</serial>
Jul 24 17:53:59 user nova-compute[70375]:     </disk>
Jul 24 17:53:59 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:53:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:53:59 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <serial>a63a7b15-4bfb-4a3e-898a-c25c1949e59c</serial>
Jul 24 17:53:59 user nova-compute[70375]:     </disk>
Jul 24 17:53:59 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:53:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:53:59 user nova-compute[70375]:       <source dev="/dev/sde"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="vdc" bus="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <serial>eff0f79b-315a-47d5-9224-395b233314f3</serial>
Jul 24 17:53:59 user nova-compute[70375]:     </disk>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:3a:12:31"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tap04ddbcba-22"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:92:c7:ce"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tap37599ee2-d3"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:e8:ae:85"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tap7e8f0011-a3"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:a3:bb:42"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tapcbb84c41-2b"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:99:02:e6"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tap22f8211e-1d"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:36:72:4a"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tape81a213a-7f"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:       <mac address="fa:16:3e:29:cd:65"/>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:       <target dev="tap66ba626e-94"/>
Jul 24 17:53:59 user nova-compute[70375]:     </interface>
Jul 24 17:53:59 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:53:59 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/console.log" append="off"/>
Jul 24 17:53:59 user nova-compute[70375]:     </serial>
Jul 24 17:53:59 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:53:59 user nova-compute[70375]:     <video>
Jul 24 17:53:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:     </video>
Jul 24 17:53:59 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:53:59 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:53:59 user nova-compute[70375]:     </rng>
Jul 24 17:53:59 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:53:59 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:53:59 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:53:59 user nova-compute[70375]:     </memballoon>
Jul 24 17:53:59 user nova-compute[70375]:   </devices>
Jul 24 17:53:59 user nova-compute[70375]: </domain>
Jul 24 17:53:59 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ddbcba-22, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04ddbcba-22, col_values=(('external_ids', {'iface-id': '04ddbcba-2231-47d5-bf3e-7e82a728169e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:12:31', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37599ee2-d3, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37599ee2-d3, col_values=(('external_ids', {'iface-id': '37599ee2-d38d-495a-86c3-42c5663a2bb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c7:ce', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8f0011-a3, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8f0011-a3, col_values=(('external_ids', {'iface-id': '7e8f0011-a379-4605-b74a-febf1e0ad798', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ae:85', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbb84c41-2b, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbb84c41-2b, col_values=(('external_ids', {'iface-id': 'cbb84c41-2bd6-41d0-ae43-13324a6503d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:bb:42', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Refreshing network info cache for port 459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap459e4526-f7, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap459e4526-f7, col_values=(('external_ids', {'iface-id': '459e4526-f733-447c-a196-9ae51825f09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:70:05', 'vm-uuid': '262e5d9e-034c-4dc6-a777-49cbc2e697a3'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22f8211e-1d, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22f8211e-1d, col_values=(('external_ids', {'iface-id': '22f8211e-1dbd-451f-994d-cf2a32825495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:02:e6', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] attach device xml: <interface type="ethernet">
Jul 24 17:53:59 user nova-compute[70375]:   <mac address="fa:16:3e:5a:70:05"/>
Jul 24 17:53:59 user nova-compute[70375]:   <model type="virtio"/>
Jul 24 17:53:59 user nova-compute[70375]:   <mtu size="1442"/>
Jul 24 17:53:59 user nova-compute[70375]:   <target dev="tap459e4526-f7"/>
Jul 24 17:53:59 user nova-compute[70375]: </interface>
Jul 24 17:53:59 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape81a213a-7f, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape81a213a-7f, col_values=(('external_ids', {'iface-id': 'e81a213a-7fa4-495f-9e06-ad06e4e61973', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:72:4a', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f')
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66ba626e-94, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66ba626e-94, col_values=(('external_ids', {'iface-id': '66ba626e-9419-4b79-9653-c3c1d3e38bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:cd:65', 'vm-uuid': 'e4c27005-3977-475c-ad11-5fd13b9e7a2e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:53:59 user nova-compute[70375]: INFO os_vif [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94')
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] No BDM found with device name hda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] No VIF found with MAC fa:16:3e:3a:12:31, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] No VIF found with MAC fa:16:3e:99:02:e6, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Using config drive
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updated VIF entry in instance network info cache for port 459e4526-f733-447c-a196-9ae51825f09d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d0db75a-556e-4303-907c-bd81bf594e7e req-b67ddeb2-b4b8-4697-9087-a0db373feced service nova] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:00 user nova-compute[70375]: WARNING nova.compute.manager [req-9e9e0d0e-0c4d-404a-9d21-32ca3b98211d req-09a49b12-d033-40f7-8301-8e4aa3e747d5 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d for instance with vm_state active and task_state None.
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name hda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No VIF found with MAC fa:16:3e:ac:2c:72, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:00 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:00</nova:creationTime>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:00 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:00 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:00 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:00 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:00 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:00 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:00 user nova-compute[70375]:     <nova:port uuid="459e4526-f733-447c-a196-9ae51825f09d">
Jul 24 17:54:00 user nova-compute[70375]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 24 17:54:00 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:00 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:00 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:00 user nova-compute[70375]:  {{(pid=70375) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b033f807-33ca-4928-8186-421513c146df tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.546s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Creating config drive at /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/disk.config
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaswoh_jq {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaswoh_jq" returned: 0 in 0.071s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:01 user nova-compute[70375]: INFO nova.compute.manager [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Attaching volume ceb6a4f3-7651-4e11-822c-a6c028746638 to /dev/vdb
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.utils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32fbd8-4274-4605-bbba-6bc418cbae84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001a994-f263-4fb0-8473-8aedd593a764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ffa55-9e96-45c7-812e-d6367966af75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3898e39-c810-4794-952a-694a827a717a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:54:01 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:54:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d84d81-02d2-4eab-a6c9-074698329d84]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG os_brick.utils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating existing volume attachment record: 97e2f75d-4215-43ca-80bb-e5072bf12708 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:54:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:02 user nova-compute[70375]: WARNING nova.compute.manager [req-6b37ffcd-62a4-4d2c-92b0-8309c1ccf920 req-40cb1f34-cd20-4f41-be0b-bdd3d47aac08 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d for instance with vm_state active and task_state None.
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:02 user nova-compute[70375]: WARNING nova.compute.manager [req-a15a5415-74db-412d-86b5-8882f56d10ee req-d8002e66-4e4e-4cae-908b-0ba190d3612b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e for instance with vm_state building and task_state spawning.
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:03 user nova-compute[70375]: WARNING nova.compute.manager [req-b406184d-d5d3-4f04-bbca-f81e4c1f5827 req-933bf769-9565-49c1-ac3b-d892164c131d service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 for instance with vm_state building and task_state spawning.
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:04 user nova-compute[70375]: WARNING nova.compute.manager [req-e018d56e-5ad1-4368-bd76-3ac96b453b4a req-9f4dd565-459e-4017-88c7-6ff0f3343434 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 for instance with vm_state building and task_state spawning.
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:04 user nova-compute[70375]: WARNING nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e for instance with vm_state building and task_state spawning.
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:04 user nova-compute[70375]: WARNING nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 for instance with vm_state building and task_state spawning.
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:04 user nova-compute[70375]: WARNING nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 for instance with vm_state building and task_state spawning.
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:04 user nova-compute[70375]: WARNING nova.compute.manager [req-dd9a9cb3-219f-4582-a183-a4119854a3c1 req-93d42046-cf6f-48cd-ae7d-177b8315e9d3 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 for instance with vm_state building and task_state spawning.
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:05 user nova-compute[70375]: WARNING nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 for instance with vm_state building and task_state spawning.
Jul 24 17:54:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:05 user nova-compute[70375]: WARNING nova.compute.manager [req-780fe135-dfd8-429e-86e1-19285bb71a99 req-21a4853b-bdbc-4cb2-b73f-e0fb73fe11d4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 for instance with vm_state building and task_state spawning.
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:06 user nova-compute[70375]: WARNING nova.compute.manager [req-ba897291-a1cf-441a-bddb-cb2d05e68974 req-9689f3e1-c4a9-4aa0-8217-094c84478e59 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 for instance with vm_state building and task_state spawning.
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:07 user nova-compute[70375]: WARNING nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 for instance with vm_state building and task_state spawning.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:07 user nova-compute[70375]: WARNING nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb for instance with vm_state building and task_state spawning.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:07 user nova-compute[70375]: WARNING nova.compute.manager [req-2685fb35-8f43-4382-965f-d4f3f1c36acf req-f2370f2b-ac85-4653-bc5a-4392b33ea148 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb for instance with vm_state building and task_state spawning.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221247.3288794, e4c27005-3977-475c-ad11-5fd13b9e7a2e => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] VM Resumed (Lifecycle Event)
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance spawned successfully.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221247.331698, e4c27005-3977-475c-ad11-5fd13b9e7a2e => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] VM Started (Lifecycle Event)
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:07 user nova-compute[70375]: WARNING nova.compute.manager [req-664d7a71-2248-4b0e-8678-75de3d07b3d3 req-72aad7ba-8b84-4dd1-8eae-ca627a3a0c7e service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 for instance with vm_state building and task_state spawning.
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Took 12.57 seconds to spawn the instance on the hypervisor.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Took 36.28 seconds to build instance.
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: INFO nova.compute.manager [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Terminating instance
Jul 24 17:54:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7d20ae5f-ee12-417a-8e01-801f14821118 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.441s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Instance destroyed successfully.
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lazy-loading 'resources' on Instance uuid 06592a39-04a0-4e73-bb76-546a29fedab3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968178223',display_name='tempest-VolumesAdminNegativeTest-server-968178223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968178223',id=7,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfz4SIJaM12nqqyBRHM/D3k/GHYYe+ghvWWATtKfQRfTNox02pkhhjDto9OB25B91LeNkNsLZVTKDxLyy9yj21OgDQkH98SoxZpfURsQVLGv3OfwlxtroYmk7hZBfYjJA==',key_name='tempest-keypair-398251727',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d425958d88754a4f8c9a31bbd7d9715c',ramdisk_id='',reservation_id='r-o1yauowy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2106539128',owner_user_name='tempest-VolumesAdminNegativeTest-2106539128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='489f6bd0397e442f8967b992adc9a998',uuid=06592a39-04a0-4e73-bb76-546a29fedab3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converting VIF {"id": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "address": "fa:16:3e:08:f8:2f", "network": {"id": "5e0822df-9816-412f-bb0c-e0d42b64f773", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-97309877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d425958d88754a4f8c9a31bbd7d9715c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a1f26-60", "ovs_interfaceid": "8b4a1f26-60a5-4e34-8427-bff51e93a458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG os_vif [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4a1f26-60, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:08 user nova-compute[70375]: INFO os_vif [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:f8:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b4a1f26-60a5-4e34-8427-bff51e93a458,network=Network(5e0822df-9816-412f-bb0c-e0d42b64f773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a1f26-60')
Jul 24 17:54:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Deleting instance files /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3_del
Jul 24 17:54:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Deletion of /opt/stack/data/nova/instances/06592a39-04a0-4e73-bb76-546a29fedab3_del complete
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing instance network info cache due to event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.network.neutron [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:54:08 user nova-compute[70375]: INFO nova.compute.manager [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 24 17:54:08 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:54:08 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG nova.network.neutron [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated VIF entry in instance network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG nova.network.neutron [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-unplugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] No waiting events found dispatching network-vif-unplugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-68d879ae-ab9d-4b55-b4bb-68b6229af2fd req-711472b7-28d0-47e0-8d12-a16fe6c1f598 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-unplugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoMINPUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:54:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:54:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:54:10 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bebe5a-b6be-48ed-b56c-72cc9edf227c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:54:10 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453b141-d388-43a4-89f7-4de1e1964c74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638] added
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8017de06-0835-4376-969e-f960e167278a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[275d8ec6-324e-43a3-8b70-e8b62c24b36a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoMINPUg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoMINPUg" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25582d9-bd12-42bf-b7cf-75743698581b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoMINPUg'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Took 1.80 seconds to deallocate network for instance.
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b7525-95d5-4d62-bad4-c2ac6d16d382]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-39dac753-a9d9-4146-8ba5-351b3d400b19 req-fd96044b-d199-400f-af63-2021425aa6b5 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-deleted-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ed9bf-5d56-43cb-9913-f0475a47b1f7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f781fd37-99b2-411a-ade6-1f037d337f58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260]
Jul 24 17:54:10 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260] successful.
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] Acquiring lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] Lock "06592a39-04a0-4e73-bb76-546a29fedab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] No waiting events found dispatching network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:10 user nova-compute[70375]: WARNING nova.compute.manager [req-a4f22da7-4abc-4895-8274-6ba2e7dcab07 req-f38fb1db-9424-4629-ab30-35fb2419add9 service nova] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Received unexpected event network-vif-plugged-8b4a1f26-60a5-4e34-8427-bff51e93a458 for instance with vm_state deleted and task_state None.
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b1505-7924-41a2-b891-b98404b88e63]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df7c830-f637-4e1e-b802-218fb68863b1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)
Jul 24 17:54:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c7c94-766d-4555-b011-9715cd5f7444]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoMINPUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:10 user nova-compute[70375]: INFO nova.compute.manager [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Unrescuing
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:54:11 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Deleted allocations for instance 06592a39-04a0-4e73-bb76-546a29fedab3
Jul 24 17:54:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8031577b-dabc-4917-858a-b3de1c6a547b tempest-VolumesAdminNegativeTest-2106539128 tempest-VolumesAdminNegativeTest-2106539128-project-member] Lock "06592a39-04a0-4e73-bb76-546a29fedab3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'flavor' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23737313361643337', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737313361643337', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:54:11 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:54:11 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:54:11 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:54:11 user nova-compute[70375]:   <serial>ceb6a4f3-7651-4e11-822c-a6c028746638</serial>
Jul 24 17:54:11 user nova-compute[70375]: </disk>
Jul 24 17:54:11 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:12 user nova-compute[70375]: WARNING nova.compute.manager [req-03b30bb3-c293-456d-845b-7a36a4137058 req-2a9759ca-c5fe-4c51-9bed-32df436015cd service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state rescued and task_state unrescuing.
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:54:12 user nova-compute[70375]: INFO nova.compute.claims [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Claim successful on node user
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No BDM found with device name hda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] No VIF found with MAC fa:16:3e:ac:2c:72, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-61d0e6ef-931a-4a91-8e83-7ddac6e0fe2c tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.254s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance destroyed successfully.
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:54:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.policy [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfe078158d1b47a2b3d162244d02ecda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b188edaccf4940b78b1b1186d66533d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:54:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Creating image(s)
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "/opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "/opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "/opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk 1073741824" returned: 0 in 0.049s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Cannot resize image /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'migration_context' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Successfully created port: 6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Ensure instance console log exists: /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:14 user nova-compute[70375]: WARNING nova.compute.manager [req-fd557c60-7136-4bed-b8fa-64c97fa16640 req-fac8f5c8-9d6e-4333-a7c8-d43d92bbecff service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state rescued and task_state unrescuing.
Jul 24 17:54:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Successfully updated port: 6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquired lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-changed-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Refreshing instance network info cache due to event network-changed-6abab823-a389-4e32-b881-b5848e321a1d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] Acquiring lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:14 user nova-compute[70375]: WARNING nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid e4c27005-3977-475c-ad11-5fd13b9e7a2e {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: INFO nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:14 user nova-compute[70375]: INFO nova.compute.manager [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Detaching volume ceb6a4f3-7651-4e11-822c-a6c028746638
Jul 24 17:54:14 user nova-compute[70375]: INFO nova.virt.block_device [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Attempting to driver detach volume ceb6a4f3-7651-4e11-822c-a6c028746638 from mountpoint /dev/vdb
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Attempting to detach device vdb from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:54:14 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:54:14 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:54:14 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:54:14 user nova-compute[70375]:   <serial>ceb6a4f3-7651-4e11-822c-a6c028746638</serial>
Jul 24 17:54:14 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 17:54:14 user nova-compute[70375]: </disk>
Jul 24 17:54:14 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:54:14 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully detached device vdb from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the persistent domain config.
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:54:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:54:14 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:54:14 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:54:14 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:54:14 user nova-compute[70375]:   <serial>ceb6a4f3-7651-4e11-822c-a6c028746638</serial>
Jul 24 17:54:14 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 17:54:14 user nova-compute[70375]: </disk>
Jul 24 17:54:14 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.neutron [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Releasing lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Instance network_info: |[{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] Acquired lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Refreshing network info cache for port 6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Start _get_guest_xml network_info=[{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:54:15 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:15 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2101802354',display_name='tempest-SnapshotDataIntegrityTests-server-2101802354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2101802354',id=19,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDznd8hG7XCgM/G+ktCGUgpu/O/NGp0N7ABk6F1rV3k6G8kfzAIFhMYsUsDNBjFx8d5VyHfmQUWgsIoMNN26E3X9KktVirFcUUqvR5LqpRyXOmJ+wySPoyqyE65lB4nfg==',key_name='tempest-keypair-780072467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b188edaccf4940b78b1b1186d66533d9',ramdisk_id='',reservation_id='r-0k7m5b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1703304380',owner_user_name='tempest-SnapshotDataIntegrityTests-1703304380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfe078158d1b47a2b3d162244d02ecda',uuid=c97c022f-1bca-4f38-b876-604724ed6442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converting VIF {"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.objects.instance [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'pci_devices' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:54:15 user nova-compute[70375]:   <uuid>c97c022f-1bca-4f38-b876-604724ed6442</uuid>
Jul 24 17:54:15 user nova-compute[70375]:   <name>instance-00000013</name>
Jul 24 17:54:15 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:54:15 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:54:15 user nova-compute[70375]:   <metadata>
Jul 24 17:54:15 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:15 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2101802354</nova:name>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:54:15</nova:creationTime>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:54:15 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:15 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:owner>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:user uuid="bfe078158d1b47a2b3d162244d02ecda">tempest-SnapshotDataIntegrityTests-1703304380-project-member</nova:user>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:project uuid="b188edaccf4940b78b1b1186d66533d9">tempest-SnapshotDataIntegrityTests-1703304380</nova:project>
Jul 24 17:54:15 user nova-compute[70375]:       </nova:owner>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:15 user nova-compute[70375]:       <nova:ports>
Jul 24 17:54:15 user nova-compute[70375]:         <nova:port uuid="6abab823-a389-4e32-b881-b5848e321a1d">
Jul 24 17:54:15 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 17:54:15 user nova-compute[70375]:         </nova:port>
Jul 24 17:54:15 user nova-compute[70375]:       </nova:ports>
Jul 24 17:54:15 user nova-compute[70375]:     </nova:instance>
Jul 24 17:54:15 user nova-compute[70375]:   </metadata>
Jul 24 17:54:15 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:54:15 user nova-compute[70375]:     <system>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="serial">c97c022f-1bca-4f38-b876-604724ed6442</entry>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="uuid">c97c022f-1bca-4f38-b876-604724ed6442</entry>
Jul 24 17:54:15 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:54:15 user nova-compute[70375]:     </system>
Jul 24 17:54:15 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:15 user nova-compute[70375]:   <os>
Jul 24 17:54:15 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:54:15 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:54:15 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:54:15 user nova-compute[70375]:   </os>
Jul 24 17:54:15 user nova-compute[70375]:   <features>
Jul 24 17:54:15 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:15 user nova-compute[70375]:     <apic/>
Jul 24 17:54:15 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:54:15 user nova-compute[70375]:   </features>
Jul 24 17:54:15 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:54:15 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:54:15 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:54:15 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:54:15 user nova-compute[70375]:   </clock>
Jul 24 17:54:15 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:54:15 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:54:15 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:54:15 user nova-compute[70375]:   </cpu>
Jul 24 17:54:15 user nova-compute[70375]:   <devices>
Jul 24 17:54:15 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:54:15 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:54:15 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk"/>
Jul 24 17:54:15 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:54:15 user nova-compute[70375]:     </disk>
Jul 24 17:54:15 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:54:15 user nova-compute[70375]:       <mac address="fa:16:3e:fa:aa:7f"/>
Jul 24 17:54:15 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:54:15 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:54:15 user nova-compute[70375]:       <target dev="tap6abab823-a3"/>
Jul 24 17:54:15 user nova-compute[70375]:     </interface>
Jul 24 17:54:15 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:54:15 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/console.log" append="off"/>
Jul 24 17:54:15 user nova-compute[70375]:     </serial>
Jul 24 17:54:15 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:54:15 user nova-compute[70375]:     <video>
Jul 24 17:54:15 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:54:15 user nova-compute[70375]:     </video>
Jul 24 17:54:15 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:54:15 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:54:15 user nova-compute[70375]:     </rng>
Jul 24 17:54:15 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:54:15 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:54:15 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:54:15 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:15 user nova-compute[70375]:   </devices>
Jul 24 17:54:15 user nova-compute[70375]: </domain>
Jul 24 17:54:15 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2101802354',display_name='tempest-SnapshotDataIntegrityTests-server-2101802354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2101802354',id=19,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDznd8hG7XCgM/G+ktCGUgpu/O/NGp0N7ABk6F1rV3k6G8kfzAIFhMYsUsDNBjFx8d5VyHfmQUWgsIoMNN26E3X9KktVirFcUUqvR5LqpRyXOmJ+wySPoyqyE65lB4nfg==',key_name='tempest-keypair-780072467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b188edaccf4940b78b1b1186d66533d9',ramdisk_id='',reservation_id='r-0k7m5b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1703304380',owner_user_name='tempest-SnapshotDataIntegrityTests-1703304380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfe078158d1b47a2b3d162244d02ecda',uuid=c97c022f-1bca-4f38-b876-604724ed6442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converting VIF {"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_vif [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abab823-a3, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6abab823-a3, col_values=(('external_ids', {'iface-id': '6abab823-a389-4e32-b881-b5848e321a1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:aa:7f', 'vm-uuid': 'c97c022f-1bca-4f38-b876-604724ed6442'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:15 user nova-compute[70375]: INFO os_vif [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3')
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No VIF found with MAC fa:16:3e:fa:aa:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221255.474562, 262e5d9e-034c-4dc6-a777-49cbc2e697a3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:54:15 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully detached device vdb from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the live domain config.
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoMINPUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:54:15 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb19c20-7a42-4693-acc9-cd98a7f16616]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:54:15 user nova-compute[70375]: No targets found.
Jul 24 17:54:15 user nova-compute[70375]: iSNS:
Jul 24 17:54:15 user nova-compute[70375]: No targets found.
Jul 24 17:54:15 user nova-compute[70375]: STATIC:
Jul 24 17:54:15 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638
Jul 24 17:54:15 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:54:15 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:54:15 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c
Jul 24 17:54:15 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:54:15 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:54:15 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:54:15 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:54:15 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:54:15 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0
Jul 24 17:54:15 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:54:15 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:54:15 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:54:15 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:54:15 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:54:15 user nova-compute[70375]: FIRMWARE:
Jul 24 17:54:15 user nova-compute[70375]: No targets found.
Jul 24 17:54:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:54:15 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:54:15 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f06513-fe78-4bde-98f8-cf1363112059]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17a8aa-43fd-447a-b670-6fc5faa7d769]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 (non-flash)
Jul 24 17:54:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe64838aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f313dd3f-60fe-4922-86db-7595e14d4903]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac407cd9-9c8d-4e35-a9f5-da51be0f7932]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07d6d94-9035-4af6-ad9f-ab3867d60e06]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updated VIF entry in instance network info cache for port 6abab823-a389-4e32-b881-b5848e321a1d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9940a4-855d-4755-a5b2-1806286e11e0]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ff2875da-b324-4824-87e4-931ab0122bdd req-564666ab-c71a-4da4-a000-1cf175838048 service nova] Releasing lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6942152-744f-4d23-a547-627bc0fe202a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f202cd2-6465-4947-9658-a3bee5e4cbbb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260]
Jul 24 17:54:15 user nova-compute[70375]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638, portal: 172.16.0.220,3260] successful.
Jul 24 17:54:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb6a4f3-7651-4e11-822c-a6c028746638 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d35d6-9b00-4509-ad0f-a12b879166ee]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] <== disconnect_volume: return (406ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:54:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:16 user nova-compute[70375]: WARNING nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state rescued and task_state unrescuing.
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:16 user nova-compute[70375]: WARNING nova.compute.manager [req-3f607eb4-5661-4c1d-a43a-5deaec606cff req-c5c87cae-3854-434e-99a9-5c24082a76a4 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state rescued and task_state unrescuing.
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dce3e3c9-5469-40df-adda-5fa9a293ff39 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for be9aa713-99fd-4e4a-a5bb-50f30de8b7ae due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221256.8485632, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Resumed (Lifecycle Event)
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0373bc1a-4c00-4b08-9fe4-c33ab368d24f tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.120s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221256.8491757, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Started (Lifecycle Event)
Jul 24 17:54:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-459e4526-f733-447c-a196-9ae51825f09d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-459e4526-f733-447c-a196-9ae51825f09d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Attempting to detach device tap459e4526-f7 from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] detach device xml: <interface type="ethernet">
Jul 24 17:54:17 user nova-compute[70375]:   <mac address="fa:16:3e:5a:70:05"/>
Jul 24 17:54:17 user nova-compute[70375]:   <model type="virtio"/>
Jul 24 17:54:17 user nova-compute[70375]:   <mtu size="1442"/>
Jul 24 17:54:17 user nova-compute[70375]:   <target dev="tap459e4526-f7"/>
Jul 24 17:54:17 user nova-compute[70375]: </interface>
Jul 24 17:54:17 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface>not found in domain: <domain type='kvm' id='17'>
Jul 24 17:54:17 user nova-compute[70375]:   <name>instance-0000000f</name>
Jul 24 17:54:17 user nova-compute[70375]:   <uuid>262e5d9e-034c-4dc6-a777-49cbc2e697a3</uuid>
Jul 24 17:54:17 user nova-compute[70375]:   <metadata>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:17 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:00</nova:creationTime>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:17 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:17 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:17 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:port uuid="459e4526-f733-447c-a196-9ae51825f09d">
Jul 24 17:54:17 user nova-compute[70375]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 24 17:54:17 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:17 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:17 user nova-compute[70375]:   </metadata>
Jul 24 17:54:17 user nova-compute[70375]:   <memory unit='KiB'>524288</memory>
Jul 24 17:54:17 user nova-compute[70375]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 17:54:17 user nova-compute[70375]:   <vcpu placement='static'>1</vcpu>
Jul 24 17:54:17 user nova-compute[70375]:   <resource>
Jul 24 17:54:17 user nova-compute[70375]:     <partition>/machine</partition>
Jul 24 17:54:17 user nova-compute[70375]:   </resource>
Jul 24 17:54:17 user nova-compute[70375]:   <sysinfo type='smbios'>
Jul 24 17:54:17 user nova-compute[70375]:     <system>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='version'>0.0.0</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='serial'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='uuid'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='family'>Virtual Machine</entry>
Jul 24 17:54:17 user nova-compute[70375]:     </system>
Jul 24 17:54:17 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:17 user nova-compute[70375]:   <os>
Jul 24 17:54:17 user nova-compute[70375]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 17:54:17 user nova-compute[70375]:     <boot dev='hd'/>
Jul 24 17:54:17 user nova-compute[70375]:     <smbios mode='sysinfo'/>
Jul 24 17:54:17 user nova-compute[70375]:   </os>
Jul 24 17:54:17 user nova-compute[70375]:   <features>
Jul 24 17:54:17 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:17 user nova-compute[70375]:     <apic/>
Jul 24 17:54:17 user nova-compute[70375]:     <vmcoreinfo state='on'/>
Jul 24 17:54:17 user nova-compute[70375]:   </features>
Jul 24 17:54:17 user nova-compute[70375]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 17:54:17 user nova-compute[70375]:     <model fallback='forbid'>Nehalem</model>
Jul 24 17:54:17 user nova-compute[70375]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='vme'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='x2apic'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='hypervisor'/>
Jul 24 17:54:17 user nova-compute[70375]:   </cpu>
Jul 24 17:54:17 user nova-compute[70375]:   <clock offset='utc'>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='hpet' present='no'/>
Jul 24 17:54:17 user nova-compute[70375]:   </clock>
Jul 24 17:54:17 user nova-compute[70375]:   <on_poweroff>destroy</on_poweroff>
Jul 24 17:54:17 user nova-compute[70375]:   <on_reboot>restart</on_reboot>
Jul 24 17:54:17 user nova-compute[70375]:   <on_crash>destroy</on_crash>
Jul 24 17:54:17 user nova-compute[70375]:   <devices>
Jul 24 17:54:17 user nova-compute[70375]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 17:54:17 user nova-compute[70375]:     <disk type='file' device='disk'>
Jul 24 17:54:17 user nova-compute[70375]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 17:54:17 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk' index='2'/>
Jul 24 17:54:17 user nova-compute[70375]:       <backingStore type='file' index='3'>
Jul 24 17:54:17 user nova-compute[70375]:         <format type='raw'/>
Jul 24 17:54:17 user nova-compute[70375]:         <source file='/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f'/>
Jul 24 17:54:17 user nova-compute[70375]:         <backingStore/>
Jul 24 17:54:17 user nova-compute[70375]:       </backingStore>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='vda' bus='virtio'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='virtio-disk0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </disk>
Jul 24 17:54:17 user nova-compute[70375]:     <disk type='file' device='cdrom'>
Jul 24 17:54:17 user nova-compute[70375]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 17:54:17 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config' index='1'/>
Jul 24 17:54:17 user nova-compute[70375]:       <backingStore/>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='hda' bus='ide'/>
Jul 24 17:54:17 user nova-compute[70375]:       <readonly/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='ide0-0-0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </disk>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='usb' index='0' model='none'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='usb'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='pci.0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='ide' index='0'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='ide'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <interface type='ethernet'>
Jul 24 17:54:17 user nova-compute[70375]:       <mac address='fa:16:3e:ac:2c:72'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='tap13da2668-5e'/>
Jul 24 17:54:17 user nova-compute[70375]:       <model type='virtio'/>
Jul 24 17:54:17 user nova-compute[70375]:       <mtu size='1442'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='net0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </interface>
Jul 24 17:54:17 user nova-compute[70375]:     <interface type='ethernet'>
Jul 24 17:54:17 user nova-compute[70375]:       <mac address='fa:16:3e:5a:70:05'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='tap459e4526-f7'/>
Jul 24 17:54:17 user nova-compute[70375]:       <model type='virtio'/>
Jul 24 17:54:17 user nova-compute[70375]:       <mtu size='1442'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='net1'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </interface>
Jul 24 17:54:17 user nova-compute[70375]:     <serial type='pty'>
Jul 24 17:54:17 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:17 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target type='isa-serial' port='0'>
Jul 24 17:54:17 user nova-compute[70375]:         <model name='isa-serial'/>
Jul 24 17:54:17 user nova-compute[70375]:       </target>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </serial>
Jul 24 17:54:17 user nova-compute[70375]:     <console type='pty' tty='/dev/pts/5'>
Jul 24 17:54:17 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:17 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target type='serial' port='0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </console>
Jul 24 17:54:17 user nova-compute[70375]:     <input type='mouse' bus='ps2'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='input0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </input>
Jul 24 17:54:17 user nova-compute[70375]:     <input type='keyboard' bus='ps2'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='input1'/>
Jul 24 17:54:17 user nova-compute[70375]:     </input>
Jul 24 17:54:17 user nova-compute[70375]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jul 24 17:54:17 user nova-compute[70375]:       <listen type='address' address='0.0.0.0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </graphics>
Jul 24 17:54:17 user nova-compute[70375]:     <audio id='1' type='none'/>
Jul 24 17:54:17 user nova-compute[70375]:     <video>
Jul 24 17:54:17 user nova-compute[70375]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='video0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </video>
Jul 24 17:54:17 user nova-compute[70375]:     <memballoon model='virtio'>
Jul 24 17:54:17 user nova-compute[70375]:       <stats period='10'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='balloon0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:17 user nova-compute[70375]:     <rng model='virtio'>
Jul 24 17:54:17 user nova-compute[70375]:       <backend model='random'>/dev/urandom</backend>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='rng0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </rng>
Jul 24 17:54:17 user nova-compute[70375]:   </devices>
Jul 24 17:54:17 user nova-compute[70375]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 17:54:17 user nova-compute[70375]:     <label>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</label>
Jul 24 17:54:17 user nova-compute[70375]:     <imagelabel>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</imagelabel>
Jul 24 17:54:17 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:17 user nova-compute[70375]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 17:54:17 user nova-compute[70375]:     <label>+64055:+108</label>
Jul 24 17:54:17 user nova-compute[70375]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 17:54:17 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:17 user nova-compute[70375]: </domain>
Jul 24 17:54:17 user nova-compute[70375]:  {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 17:54:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully detached device tap459e4526-f7 from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the persistent domain config.
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] (1/8): Attempting to detach device tap459e4526-f7 with device alias net1 from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] detach device xml: <interface type="ethernet">
Jul 24 17:54:17 user nova-compute[70375]:   <mac address="fa:16:3e:5a:70:05"/>
Jul 24 17:54:17 user nova-compute[70375]:   <model type="virtio"/>
Jul 24 17:54:17 user nova-compute[70375]:   <mtu size="1442"/>
Jul 24 17:54:17 user nova-compute[70375]:   <target dev="tap459e4526-f7"/>
Jul 24 17:54:17 user nova-compute[70375]: </interface>
Jul 24 17:54:17 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221257.5851266, 262e5d9e-034c-4dc6-a777-49cbc2e697a3 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Start waiting for the detach event from libvirt for device tap459e4526-f7 with device alias net1 for instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface>not found in domain: <domain type='kvm' id='17'>
Jul 24 17:54:17 user nova-compute[70375]:   <name>instance-0000000f</name>
Jul 24 17:54:17 user nova-compute[70375]:   <uuid>262e5d9e-034c-4dc6-a777-49cbc2e697a3</uuid>
Jul 24 17:54:17 user nova-compute[70375]:   <metadata>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:17 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:00</nova:creationTime>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:17 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:17 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:17 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:port uuid="459e4526-f733-447c-a196-9ae51825f09d">
Jul 24 17:54:17 user nova-compute[70375]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 24 17:54:17 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:17 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:17 user nova-compute[70375]:   </metadata>
Jul 24 17:54:17 user nova-compute[70375]:   <memory unit='KiB'>524288</memory>
Jul 24 17:54:17 user nova-compute[70375]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 17:54:17 user nova-compute[70375]:   <vcpu placement='static'>1</vcpu>
Jul 24 17:54:17 user nova-compute[70375]:   <resource>
Jul 24 17:54:17 user nova-compute[70375]:     <partition>/machine</partition>
Jul 24 17:54:17 user nova-compute[70375]:   </resource>
Jul 24 17:54:17 user nova-compute[70375]:   <sysinfo type='smbios'>
Jul 24 17:54:17 user nova-compute[70375]:     <system>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='version'>0.0.0</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='serial'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='uuid'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:17 user nova-compute[70375]:       <entry name='family'>Virtual Machine</entry>
Jul 24 17:54:17 user nova-compute[70375]:     </system>
Jul 24 17:54:17 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:17 user nova-compute[70375]:   <os>
Jul 24 17:54:17 user nova-compute[70375]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 17:54:17 user nova-compute[70375]:     <boot dev='hd'/>
Jul 24 17:54:17 user nova-compute[70375]:     <smbios mode='sysinfo'/>
Jul 24 17:54:17 user nova-compute[70375]:   </os>
Jul 24 17:54:17 user nova-compute[70375]:   <features>
Jul 24 17:54:17 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:17 user nova-compute[70375]:     <apic/>
Jul 24 17:54:17 user nova-compute[70375]:     <vmcoreinfo state='on'/>
Jul 24 17:54:17 user nova-compute[70375]:   </features>
Jul 24 17:54:17 user nova-compute[70375]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 17:54:17 user nova-compute[70375]:     <model fallback='forbid'>Nehalem</model>
Jul 24 17:54:17 user nova-compute[70375]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='vme'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='x2apic'/>
Jul 24 17:54:17 user nova-compute[70375]:     <feature policy='require' name='hypervisor'/>
Jul 24 17:54:17 user nova-compute[70375]:   </cpu>
Jul 24 17:54:17 user nova-compute[70375]:   <clock offset='utc'>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 17:54:17 user nova-compute[70375]:     <timer name='hpet' present='no'/>
Jul 24 17:54:17 user nova-compute[70375]:   </clock>
Jul 24 17:54:17 user nova-compute[70375]:   <on_poweroff>destroy</on_poweroff>
Jul 24 17:54:17 user nova-compute[70375]:   <on_reboot>restart</on_reboot>
Jul 24 17:54:17 user nova-compute[70375]:   <on_crash>destroy</on_crash>
Jul 24 17:54:17 user nova-compute[70375]:   <devices>
Jul 24 17:54:17 user nova-compute[70375]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 17:54:17 user nova-compute[70375]:     <disk type='file' device='disk'>
Jul 24 17:54:17 user nova-compute[70375]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 17:54:17 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk' index='2'/>
Jul 24 17:54:17 user nova-compute[70375]:       <backingStore type='file' index='3'>
Jul 24 17:54:17 user nova-compute[70375]:         <format type='raw'/>
Jul 24 17:54:17 user nova-compute[70375]:         <source file='/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f'/>
Jul 24 17:54:17 user nova-compute[70375]:         <backingStore/>
Jul 24 17:54:17 user nova-compute[70375]:       </backingStore>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='vda' bus='virtio'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='virtio-disk0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </disk>
Jul 24 17:54:17 user nova-compute[70375]:     <disk type='file' device='cdrom'>
Jul 24 17:54:17 user nova-compute[70375]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 17:54:17 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config' index='1'/>
Jul 24 17:54:17 user nova-compute[70375]:       <backingStore/>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='hda' bus='ide'/>
Jul 24 17:54:17 user nova-compute[70375]:       <readonly/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='ide0-0-0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </disk>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='usb' index='0' model='none'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='usb'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='pci.0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <controller type='ide' index='0'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='ide'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 17:54:17 user nova-compute[70375]:     </controller>
Jul 24 17:54:17 user nova-compute[70375]:     <interface type='ethernet'>
Jul 24 17:54:17 user nova-compute[70375]:       <mac address='fa:16:3e:ac:2c:72'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target dev='tap13da2668-5e'/>
Jul 24 17:54:17 user nova-compute[70375]:       <model type='virtio'/>
Jul 24 17:54:17 user nova-compute[70375]:       <mtu size='1442'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='net0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </interface>
Jul 24 17:54:17 user nova-compute[70375]:     <serial type='pty'>
Jul 24 17:54:17 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:17 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target type='isa-serial' port='0'>
Jul 24 17:54:17 user nova-compute[70375]:         <model name='isa-serial'/>
Jul 24 17:54:17 user nova-compute[70375]:       </target>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </serial>
Jul 24 17:54:17 user nova-compute[70375]:     <console type='pty' tty='/dev/pts/5'>
Jul 24 17:54:17 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:17 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:17 user nova-compute[70375]:       <target type='serial' port='0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </console>
Jul 24 17:54:17 user nova-compute[70375]:     <input type='mouse' bus='ps2'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='input0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </input>
Jul 24 17:54:17 user nova-compute[70375]:     <input type='keyboard' bus='ps2'>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='input1'/>
Jul 24 17:54:17 user nova-compute[70375]:     </input>
Jul 24 17:54:17 user nova-compute[70375]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jul 24 17:54:17 user nova-compute[70375]:       <listen type='address' address='0.0.0.0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </graphics>
Jul 24 17:54:17 user nova-compute[70375]:     <audio id='1' type='none'/>
Jul 24 17:54:17 user nova-compute[70375]:     <video>
Jul 24 17:54:17 user nova-compute[70375]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='video0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </video>
Jul 24 17:54:17 user nova-compute[70375]:     <memballoon model='virtio'>
Jul 24 17:54:17 user nova-compute[70375]:       <stats period='10'/>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='balloon0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:17 user nova-compute[70375]:     <rng model='virtio'>
Jul 24 17:54:17 user nova-compute[70375]:       <backend model='random'>/dev/urandom</backend>
Jul 24 17:54:17 user nova-compute[70375]:       <alias name='rng0'/>
Jul 24 17:54:17 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 17:54:17 user nova-compute[70375]:     </rng>
Jul 24 17:54:17 user nova-compute[70375]:   </devices>
Jul 24 17:54:17 user nova-compute[70375]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 17:54:17 user nova-compute[70375]:     <label>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</label>
Jul 24 17:54:17 user nova-compute[70375]:     <imagelabel>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</imagelabel>
Jul 24 17:54:17 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:17 user nova-compute[70375]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 17:54:17 user nova-compute[70375]:     <label>+64055:+108</label>
Jul 24 17:54:17 user nova-compute[70375]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 17:54:17 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:17 user nova-compute[70375]: </domain>
Jul 24 17:54:17 user nova-compute[70375]:  {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 17:54:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully detached device tap459e4526-f7 from instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 from the live domain config.
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG os_vif [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap459e4526-f7, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:54:17 user nova-compute[70375]: INFO os_vif [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7')
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:17 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:17</nova:creationTime>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:17 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:17 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:17 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:17 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:17 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:17 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:17 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:17 user nova-compute[70375]:  {{(pid=70375) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-unplugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-unplugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:17 user nova-compute[70375]: WARNING nova.compute.manager [req-1a5094e8-c580-4381-9b22-2b326dca27df req-a3704233-fa32-4922-9f6c-dcc6a576f91b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-unplugged-459e4526-f733-447c-a196-9ae51825f09d for instance with vm_state active and task_state None.
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-deleted-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:18 user nova-compute[70375]: INFO nova.compute.manager [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Neutron deleted interface 459e4526-f733-447c-a196-9ae51825f09d; detaching it from the instance and deleting it from the info cache
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquired lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.objects.instance [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Lazy-loading 'system_metadata' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.objects.instance [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Lazy-loading 'flavor' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface>not found in domain: <domain type='kvm' id='17'>
Jul 24 17:54:18 user nova-compute[70375]:   <name>instance-0000000f</name>
Jul 24 17:54:18 user nova-compute[70375]:   <uuid>262e5d9e-034c-4dc6-a777-49cbc2e697a3</uuid>
Jul 24 17:54:18 user nova-compute[70375]:   <metadata>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:18 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:17</nova:creationTime>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:18 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:18 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:18 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:18 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:18 user nova-compute[70375]:   </metadata>
Jul 24 17:54:18 user nova-compute[70375]:   <memory unit='KiB'>524288</memory>
Jul 24 17:54:18 user nova-compute[70375]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 17:54:18 user nova-compute[70375]:   <vcpu placement='static'>1</vcpu>
Jul 24 17:54:18 user nova-compute[70375]:   <resource>
Jul 24 17:54:18 user nova-compute[70375]:     <partition>/machine</partition>
Jul 24 17:54:18 user nova-compute[70375]:   </resource>
Jul 24 17:54:18 user nova-compute[70375]:   <sysinfo type='smbios'>
Jul 24 17:54:18 user nova-compute[70375]:     <system>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='version'>0.0.0</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='serial'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='uuid'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='family'>Virtual Machine</entry>
Jul 24 17:54:18 user nova-compute[70375]:     </system>
Jul 24 17:54:18 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:18 user nova-compute[70375]:   <os>
Jul 24 17:54:18 user nova-compute[70375]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 17:54:18 user nova-compute[70375]:     <boot dev='hd'/>
Jul 24 17:54:18 user nova-compute[70375]:     <smbios mode='sysinfo'/>
Jul 24 17:54:18 user nova-compute[70375]:   </os>
Jul 24 17:54:18 user nova-compute[70375]:   <features>
Jul 24 17:54:18 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:18 user nova-compute[70375]:     <apic/>
Jul 24 17:54:18 user nova-compute[70375]:     <vmcoreinfo state='on'/>
Jul 24 17:54:18 user nova-compute[70375]:   </features>
Jul 24 17:54:18 user nova-compute[70375]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 17:54:18 user nova-compute[70375]:     <model fallback='forbid'>Nehalem</model>
Jul 24 17:54:18 user nova-compute[70375]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='vme'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='x2apic'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='hypervisor'/>
Jul 24 17:54:18 user nova-compute[70375]:   </cpu>
Jul 24 17:54:18 user nova-compute[70375]:   <clock offset='utc'>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='hpet' present='no'/>
Jul 24 17:54:18 user nova-compute[70375]:   </clock>
Jul 24 17:54:18 user nova-compute[70375]:   <on_poweroff>destroy</on_poweroff>
Jul 24 17:54:18 user nova-compute[70375]:   <on_reboot>restart</on_reboot>
Jul 24 17:54:18 user nova-compute[70375]:   <on_crash>destroy</on_crash>
Jul 24 17:54:18 user nova-compute[70375]:   <devices>
Jul 24 17:54:18 user nova-compute[70375]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 17:54:18 user nova-compute[70375]:     <disk type='file' device='disk'>
Jul 24 17:54:18 user nova-compute[70375]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 17:54:18 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk' index='2'/>
Jul 24 17:54:18 user nova-compute[70375]:       <backingStore type='file' index='3'>
Jul 24 17:54:18 user nova-compute[70375]:         <format type='raw'/>
Jul 24 17:54:18 user nova-compute[70375]:         <source file='/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f'/>
Jul 24 17:54:18 user nova-compute[70375]:         <backingStore/>
Jul 24 17:54:18 user nova-compute[70375]:       </backingStore>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='vda' bus='virtio'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='virtio-disk0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </disk>
Jul 24 17:54:18 user nova-compute[70375]:     <disk type='file' device='cdrom'>
Jul 24 17:54:18 user nova-compute[70375]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 17:54:18 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config' index='1'/>
Jul 24 17:54:18 user nova-compute[70375]:       <backingStore/>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='hda' bus='ide'/>
Jul 24 17:54:18 user nova-compute[70375]:       <readonly/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='ide0-0-0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </disk>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='usb' index='0' model='none'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='usb'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='pci.0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='ide' index='0'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='ide'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <interface type='ethernet'>
Jul 24 17:54:18 user nova-compute[70375]:       <mac address='fa:16:3e:ac:2c:72'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='tap13da2668-5e'/>
Jul 24 17:54:18 user nova-compute[70375]:       <model type='virtio'/>
Jul 24 17:54:18 user nova-compute[70375]:       <mtu size='1442'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='net0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </interface>
Jul 24 17:54:18 user nova-compute[70375]:     <serial type='pty'>
Jul 24 17:54:18 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:18 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target type='isa-serial' port='0'>
Jul 24 17:54:18 user nova-compute[70375]:         <model name='isa-serial'/>
Jul 24 17:54:18 user nova-compute[70375]:       </target>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </serial>
Jul 24 17:54:18 user nova-compute[70375]:     <console type='pty' tty='/dev/pts/5'>
Jul 24 17:54:18 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:18 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target type='serial' port='0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </console>
Jul 24 17:54:18 user nova-compute[70375]:     <input type='mouse' bus='ps2'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='input0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </input>
Jul 24 17:54:18 user nova-compute[70375]:     <input type='keyboard' bus='ps2'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='input1'/>
Jul 24 17:54:18 user nova-compute[70375]:     </input>
Jul 24 17:54:18 user nova-compute[70375]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jul 24 17:54:18 user nova-compute[70375]:       <listen type='address' address='0.0.0.0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </graphics>
Jul 24 17:54:18 user nova-compute[70375]:     <audio id='1' type='none'/>
Jul 24 17:54:18 user nova-compute[70375]:     <video>
Jul 24 17:54:18 user nova-compute[70375]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='video0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </video>
Jul 24 17:54:18 user nova-compute[70375]:     <memballoon model='virtio'>
Jul 24 17:54:18 user nova-compute[70375]:       <stats period='10'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='balloon0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:18 user nova-compute[70375]:     <rng model='virtio'>
Jul 24 17:54:18 user nova-compute[70375]:       <backend model='random'>/dev/urandom</backend>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='rng0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </rng>
Jul 24 17:54:18 user nova-compute[70375]:   </devices>
Jul 24 17:54:18 user nova-compute[70375]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 17:54:18 user nova-compute[70375]:     <label>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</label>
Jul 24 17:54:18 user nova-compute[70375]:     <imagelabel>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</imagelabel>
Jul 24 17:54:18 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:18 user nova-compute[70375]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 17:54:18 user nova-compute[70375]:     <label>+64055:+108</label>
Jul 24 17:54:18 user nova-compute[70375]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 17:54:18 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:18 user nova-compute[70375]: </domain>
Jul 24 17:54:18 user nova-compute[70375]:  {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface> {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5a:70:05"/><model type="virtio"/><mtu size="1442"/><target dev="tap459e4526-f7"/></interface>not found in domain: <domain type='kvm' id='17'>
Jul 24 17:54:18 user nova-compute[70375]:   <name>instance-0000000f</name>
Jul 24 17:54:18 user nova-compute[70375]:   <uuid>262e5d9e-034c-4dc6-a777-49cbc2e697a3</uuid>
Jul 24 17:54:18 user nova-compute[70375]:   <metadata>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:18 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:17</nova:creationTime>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:18 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:18 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:18 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:18 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:18 user nova-compute[70375]:   </metadata>
Jul 24 17:54:18 user nova-compute[70375]:   <memory unit='KiB'>524288</memory>
Jul 24 17:54:18 user nova-compute[70375]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 17:54:18 user nova-compute[70375]:   <vcpu placement='static'>1</vcpu>
Jul 24 17:54:18 user nova-compute[70375]:   <resource>
Jul 24 17:54:18 user nova-compute[70375]:     <partition>/machine</partition>
Jul 24 17:54:18 user nova-compute[70375]:   </resource>
Jul 24 17:54:18 user nova-compute[70375]:   <sysinfo type='smbios'>
Jul 24 17:54:18 user nova-compute[70375]:     <system>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='version'>0.0.0</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='serial'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='uuid'>262e5d9e-034c-4dc6-a777-49cbc2e697a3</entry>
Jul 24 17:54:18 user nova-compute[70375]:       <entry name='family'>Virtual Machine</entry>
Jul 24 17:54:18 user nova-compute[70375]:     </system>
Jul 24 17:54:18 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:18 user nova-compute[70375]:   <os>
Jul 24 17:54:18 user nova-compute[70375]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 17:54:18 user nova-compute[70375]:     <boot dev='hd'/>
Jul 24 17:54:18 user nova-compute[70375]:     <smbios mode='sysinfo'/>
Jul 24 17:54:18 user nova-compute[70375]:   </os>
Jul 24 17:54:18 user nova-compute[70375]:   <features>
Jul 24 17:54:18 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:18 user nova-compute[70375]:     <apic/>
Jul 24 17:54:18 user nova-compute[70375]:     <vmcoreinfo state='on'/>
Jul 24 17:54:18 user nova-compute[70375]:   </features>
Jul 24 17:54:18 user nova-compute[70375]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 17:54:18 user nova-compute[70375]:     <model fallback='forbid'>Nehalem</model>
Jul 24 17:54:18 user nova-compute[70375]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='vme'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='x2apic'/>
Jul 24 17:54:18 user nova-compute[70375]:     <feature policy='require' name='hypervisor'/>
Jul 24 17:54:18 user nova-compute[70375]:   </cpu>
Jul 24 17:54:18 user nova-compute[70375]:   <clock offset='utc'>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 17:54:18 user nova-compute[70375]:     <timer name='hpet' present='no'/>
Jul 24 17:54:18 user nova-compute[70375]:   </clock>
Jul 24 17:54:18 user nova-compute[70375]:   <on_poweroff>destroy</on_poweroff>
Jul 24 17:54:18 user nova-compute[70375]:   <on_reboot>restart</on_reboot>
Jul 24 17:54:18 user nova-compute[70375]:   <on_crash>destroy</on_crash>
Jul 24 17:54:18 user nova-compute[70375]:   <devices>
Jul 24 17:54:18 user nova-compute[70375]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 17:54:18 user nova-compute[70375]:     <disk type='file' device='disk'>
Jul 24 17:54:18 user nova-compute[70375]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 17:54:18 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk' index='2'/>
Jul 24 17:54:18 user nova-compute[70375]:       <backingStore type='file' index='3'>
Jul 24 17:54:18 user nova-compute[70375]:         <format type='raw'/>
Jul 24 17:54:18 user nova-compute[70375]:         <source file='/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f'/>
Jul 24 17:54:18 user nova-compute[70375]:         <backingStore/>
Jul 24 17:54:18 user nova-compute[70375]:       </backingStore>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='vda' bus='virtio'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='virtio-disk0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </disk>
Jul 24 17:54:18 user nova-compute[70375]:     <disk type='file' device='cdrom'>
Jul 24 17:54:18 user nova-compute[70375]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 17:54:18 user nova-compute[70375]:       <source file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk.config' index='1'/>
Jul 24 17:54:18 user nova-compute[70375]:       <backingStore/>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='hda' bus='ide'/>
Jul 24 17:54:18 user nova-compute[70375]:       <readonly/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='ide0-0-0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </disk>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='usb' index='0' model='none'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='usb'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='pci.0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <controller type='ide' index='0'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='ide'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 17:54:18 user nova-compute[70375]:     </controller>
Jul 24 17:54:18 user nova-compute[70375]:     <interface type='ethernet'>
Jul 24 17:54:18 user nova-compute[70375]:       <mac address='fa:16:3e:ac:2c:72'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target dev='tap13da2668-5e'/>
Jul 24 17:54:18 user nova-compute[70375]:       <model type='virtio'/>
Jul 24 17:54:18 user nova-compute[70375]:       <mtu size='1442'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='net0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </interface>
Jul 24 17:54:18 user nova-compute[70375]:     <serial type='pty'>
Jul 24 17:54:18 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:18 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target type='isa-serial' port='0'>
Jul 24 17:54:18 user nova-compute[70375]:         <model name='isa-serial'/>
Jul 24 17:54:18 user nova-compute[70375]:       </target>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </serial>
Jul 24 17:54:18 user nova-compute[70375]:     <console type='pty' tty='/dev/pts/5'>
Jul 24 17:54:18 user nova-compute[70375]:       <source path='/dev/pts/5'/>
Jul 24 17:54:18 user nova-compute[70375]:       <log file='/opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/console.log' append='off'/>
Jul 24 17:54:18 user nova-compute[70375]:       <target type='serial' port='0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='serial0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </console>
Jul 24 17:54:18 user nova-compute[70375]:     <input type='mouse' bus='ps2'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='input0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </input>
Jul 24 17:54:18 user nova-compute[70375]:     <input type='keyboard' bus='ps2'>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='input1'/>
Jul 24 17:54:18 user nova-compute[70375]:     </input>
Jul 24 17:54:18 user nova-compute[70375]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jul 24 17:54:18 user nova-compute[70375]:       <listen type='address' address='0.0.0.0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </graphics>
Jul 24 17:54:18 user nova-compute[70375]:     <audio id='1' type='none'/>
Jul 24 17:54:18 user nova-compute[70375]:     <video>
Jul 24 17:54:18 user nova-compute[70375]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='video0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </video>
Jul 24 17:54:18 user nova-compute[70375]:     <memballoon model='virtio'>
Jul 24 17:54:18 user nova-compute[70375]:       <stats period='10'/>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='balloon0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:18 user nova-compute[70375]:     <rng model='virtio'>
Jul 24 17:54:18 user nova-compute[70375]:       <backend model='random'>/dev/urandom</backend>
Jul 24 17:54:18 user nova-compute[70375]:       <alias name='rng0'/>
Jul 24 17:54:18 user nova-compute[70375]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 17:54:18 user nova-compute[70375]:     </rng>
Jul 24 17:54:18 user nova-compute[70375]:   </devices>
Jul 24 17:54:18 user nova-compute[70375]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 17:54:18 user nova-compute[70375]:     <label>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</label>
Jul 24 17:54:18 user nova-compute[70375]:     <imagelabel>libvirt-262e5d9e-034c-4dc6-a777-49cbc2e697a3</imagelabel>
Jul 24 17:54:18 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:18 user nova-compute[70375]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 17:54:18 user nova-compute[70375]:     <label>+64055:+108</label>
Jul 24 17:54:18 user nova-compute[70375]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 17:54:18 user nova-compute[70375]:   </seclabel>
Jul 24 17:54:18 user nova-compute[70375]: </domain>
Jul 24 17:54:18 user nova-compute[70375]:  {{(pid=70375) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 17:54:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Detaching interface fa:16:3e:5a:70:05 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap459e4526-f7' not found.
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Converting VIF {"id": "459e4526-f733-447c-a196-9ae51825f09d", "address": "fa:16:3e:5a:70:05", "network": {"id": "f923376a-c244-41b8-b9b3-642ddde45b35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-905501126", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459e4526-f7", "ovs_interfaceid": "459e4526-f733-447c-a196-9ae51825f09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG os_vif [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap459e4526-f7, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:54:18 user nova-compute[70375]: INFO os_vif [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:70:05,bridge_name='br-int',has_traffic_filtering=True,id=459e4526-f733-447c-a196-9ae51825f09d,network=Network(f923376a-c244-41b8-b9b3-642ddde45b35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459e4526-f7')
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [req-81b83623-5a7a-4c2d-a1aa-d885ab7cfaa3 req-7eae6382-1241-4aa6-8da3-1a3d4f5bb80a service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:18 user nova-compute[70375]:   <nova:package version="0.0.0"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:name>tempest-device-tagging-server-165311063</nova:name>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:creationTime>2023-07-24 17:54:18</nova:creationTime>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:flavor name="m1.tiny">
Jul 24 17:54:18 user nova-compute[70375]:     <nova:memory>512</nova:memory>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:disk>1</nova:disk>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:swap>0</nova:swap>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:flavor>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:user uuid="9fb73acfd51b4e1ea6efb319ce639881">tempest-TaggedAttachmentsTest-1218286187-project-member</nova:user>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:project uuid="3444fa91ae1a496987218fedaf7b5e04">tempest-TaggedAttachmentsTest-1218286187</nova:project>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:owner>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:18 user nova-compute[70375]:   <nova:ports>
Jul 24 17:54:18 user nova-compute[70375]:     <nova:port uuid="13da2668-5eab-4063-be21-265d9433e5f8">
Jul 24 17:54:18 user nova-compute[70375]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:54:18 user nova-compute[70375]:     </nova:port>
Jul 24 17:54:18 user nova-compute[70375]:   </nova:ports>
Jul 24 17:54:18 user nova-compute[70375]: </nova:instance>
Jul 24 17:54:18 user nova-compute[70375]:  {{(pid=70375) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] No waiting events found dispatching network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:18 user nova-compute[70375]: WARNING nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received unexpected event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d for instance with vm_state building and task_state spawning.
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] No waiting events found dispatching network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:18 user nova-compute[70375]: WARNING nova.compute.manager [req-692dff13-b4e9-4e9a-bcc0-8ec5ddee35b5 req-9f63fd98-ae58-4a73-9c35-b5ecf40e972f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received unexpected event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d for instance with vm_state building and task_state spawning.
Jul 24 17:54:18 user nova-compute[70375]: INFO nova.network.neutron [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Port 459e4526-f733-447c-a196-9ae51825f09d from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 24 17:54:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [{"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Releasing lock "refresh_cache-262e5d9e-034c-4dc6-a777-49cbc2e697a3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4feaf0a4-4009-444e-9101-1b09f0e89816 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "interface-262e5d9e-034c-4dc6-a777-49cbc2e697a3-459e4526-f733-447c-a196-9ae51825f09d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.794s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221259.3014727, c97c022f-1bca-4f38-b876-604724ed6442 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] VM Resumed (Lifecycle Event)
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Instance spawned successfully.
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221259.31513, c97c022f-1bca-4f38-b876-604724ed6442 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] VM Started (Lifecycle Event)
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Took 6.48 seconds to spawn the instance on the hypervisor.
Jul 24 17:54:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Took 7.38 seconds to build instance.
Jul 24 17:54:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-efad832a-4197-47b0-adbf-40e2ea7fcb2f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.507s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.979s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:19 user nova-compute[70375]: INFO nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:20 user nova-compute[70375]: WARNING nova.compute.manager [req-d5ce2d54-ced4-4aa7-832d-2edeb36263c3 req-56635fbc-e0e4-49ca-a97e-4f375eda06ba service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-459e4526-f733-447c-a196-9ae51825f09d for instance with vm_state active and task_state None.
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:54:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:21 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:54:21 user nova-compute[70375]: INFO nova.compute.claims [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Claim successful on node user
Jul 24 17:54:22 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:54:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:54:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.policy [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edc5d742d0f4dc3ba67f1fad87937ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce4fa18b04c41078f64aa0af0777e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:54:23 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Creating image(s)
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "/opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.191s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221248.4826782, 06592a39-04a0-4e73-bb76-546a29fedab3 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:23 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] VM Stopped (Lifecycle Event)
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-210caa6c-b899-4c69-acee-54e3688f65c9 None None] [instance: 06592a39-04a0-4e73-bb76-546a29fedab3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk 1073741824" returned: 0 in 0.093s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.177s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Successfully created port: 57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Cannot resize image /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.objects.instance [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'migration_context' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Ensure instance console log exists: /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Successfully updated port: 57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquired lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-changed-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Refreshing instance network info cache due to event network-changed-57a5dc5d-5db6-437b-8579-def74159e777. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] Acquiring lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:24 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updating instance_info_cache with network_info: [{"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Releasing lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Instance network_info: |[{"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] Acquired lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Refreshing network info cache for port 57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Start _get_guest_xml network_info=[{"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:54:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30987841',display_name='tempest-AttachVolumeNegativeTest-server-30987841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30987841',id=20,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNfM9jg2OwCGRChWJeGd08leM7FNzlBZSJxfJkZQZOMBlA6Ud3+aibqH1kEtFOL7dF590w601F4VP2XZf362XajsJhsDP5lWJCJNpdvnF7fVassu3biiu4oq7F++KSx/A==',key_name='tempest-keypair-740555913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-u14194fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=f377f3ff-db0f-40f5-b183-e493a90c0e9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.objects.instance [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'pci_devices' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:54:25 user nova-compute[70375]:   <uuid>f377f3ff-db0f-40f5-b183-e493a90c0e9b</uuid>
Jul 24 17:54:25 user nova-compute[70375]:   <name>instance-00000014</name>
Jul 24 17:54:25 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:54:25 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:54:25 user nova-compute[70375]:   <metadata>
Jul 24 17:54:25 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:54:25 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeNegativeTest-server-30987841</nova:name>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:54:25</nova:creationTime>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:54:25 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:54:25 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:owner>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:user uuid="3edc5d742d0f4dc3ba67f1fad87937ac">tempest-AttachVolumeNegativeTest-777978815-project-member</nova:user>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:project uuid="7ce4fa18b04c41078f64aa0af0777e51">tempest-AttachVolumeNegativeTest-777978815</nova:project>
Jul 24 17:54:25 user nova-compute[70375]:       </nova:owner>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:54:25 user nova-compute[70375]:       <nova:ports>
Jul 24 17:54:25 user nova-compute[70375]:         <nova:port uuid="57a5dc5d-5db6-437b-8579-def74159e777">
Jul 24 17:54:25 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 17:54:25 user nova-compute[70375]:         </nova:port>
Jul 24 17:54:25 user nova-compute[70375]:       </nova:ports>
Jul 24 17:54:25 user nova-compute[70375]:     </nova:instance>
Jul 24 17:54:25 user nova-compute[70375]:   </metadata>
Jul 24 17:54:25 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:54:25 user nova-compute[70375]:     <system>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="serial">f377f3ff-db0f-40f5-b183-e493a90c0e9b</entry>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="uuid">f377f3ff-db0f-40f5-b183-e493a90c0e9b</entry>
Jul 24 17:54:25 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:54:25 user nova-compute[70375]:     </system>
Jul 24 17:54:25 user nova-compute[70375]:   </sysinfo>
Jul 24 17:54:25 user nova-compute[70375]:   <os>
Jul 24 17:54:25 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:54:25 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:54:25 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:54:25 user nova-compute[70375]:   </os>
Jul 24 17:54:25 user nova-compute[70375]:   <features>
Jul 24 17:54:25 user nova-compute[70375]:     <acpi/>
Jul 24 17:54:25 user nova-compute[70375]:     <apic/>
Jul 24 17:54:25 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:54:25 user nova-compute[70375]:   </features>
Jul 24 17:54:25 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:54:25 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:54:25 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:54:25 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:54:25 user nova-compute[70375]:   </clock>
Jul 24 17:54:25 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:54:25 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:54:25 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:54:25 user nova-compute[70375]:   </cpu>
Jul 24 17:54:25 user nova-compute[70375]:   <devices>
Jul 24 17:54:25 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:54:25 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:54:25 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk"/>
Jul 24 17:54:25 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:54:25 user nova-compute[70375]:     </disk>
Jul 24 17:54:25 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:54:25 user nova-compute[70375]:       <mac address="fa:16:3e:11:d9:6b"/>
Jul 24 17:54:25 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:54:25 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:54:25 user nova-compute[70375]:       <target dev="tap57a5dc5d-5d"/>
Jul 24 17:54:25 user nova-compute[70375]:     </interface>
Jul 24 17:54:25 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:54:25 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/console.log" append="off"/>
Jul 24 17:54:25 user nova-compute[70375]:     </serial>
Jul 24 17:54:25 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:54:25 user nova-compute[70375]:     <video>
Jul 24 17:54:25 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:54:25 user nova-compute[70375]:     </video>
Jul 24 17:54:25 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:54:25 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:54:25 user nova-compute[70375]:     </rng>
Jul 24 17:54:25 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:54:25 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:54:25 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:54:25 user nova-compute[70375]:     </memballoon>
Jul 24 17:54:25 user nova-compute[70375]:   </devices>
Jul 24 17:54:25 user nova-compute[70375]: </domain>
Jul 24 17:54:25 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30987841',display_name='tempest-AttachVolumeNegativeTest-server-30987841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30987841',id=20,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNfM9jg2OwCGRChWJeGd08leM7FNzlBZSJxfJkZQZOMBlA6Ud3+aibqH1kEtFOL7dF590w601F4VP2XZf362XajsJhsDP5lWJCJNpdvnF7fVassu3biiu4oq7F++KSx/A==',key_name='tempest-keypair-740555913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-u14194fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=f377f3ff-db0f-40f5-b183-e493a90c0e9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG os_vif [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57a5dc5d-5d, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57a5dc5d-5d, col_values=(('external_ids', {'iface-id': '57a5dc5d-5db6-437b-8579-def74159e777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:d9:6b', 'vm-uuid': 'f377f3ff-db0f-40f5-b183-e493a90c0e9b'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:25 user nova-compute[70375]: INFO os_vif [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d')
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:11:d9:6b, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updated VIF entry in instance network info cache for port 57a5dc5d-5db6-437b-8579-def74159e777. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updating instance_info_cache with network_info: [{"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27996bc5-af9e-40f9-aca7-eb329d8368ff req-6a2c6b64-182f-474c-805a-65cdaa5c76e1 service nova] Releasing lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:27 user nova-compute[70375]: WARNING nova.compute.manager [req-69925ff1-b5ca-4a61-a25b-f4fe6d2794bd req-5a363843-f268-4de6-b2db-5b57e9e8a9ae service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state building and task_state spawning.
Jul 24 17:54:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221269.1906145, f377f3ff-db0f-40f5-b183-e493a90c0e9b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] VM Resumed (Lifecycle Event)
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Instance spawned successfully.
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221269.1977305, f377f3ff-db0f-40f5-b183-e493a90c0e9b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] VM Started (Lifecycle Event)
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Took 6.29 seconds to spawn the instance on the hypervisor.
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:54:29 user nova-compute[70375]: INFO nova.compute.manager [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Took 7.59 seconds to build instance.
Jul 24 17:54:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5bc65420-0b19-4fab-9da7-9a329da82356 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.721s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:54:29 user nova-compute[70375]: WARNING nova.compute.manager [req-915535f3-cc24-404f-b5ff-3c46c818c3c7 req-667467a2-d19e-4afb-a616-18ccf4fafaf9 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state active and task_state None.
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:54:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:54:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7385MB free_disk=24.52320098876953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f9510c63-82f2-4055-abf6-3de637e27309 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f377f3ff-db0f-40f5-b183-e493a90c0e9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:54:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-changed-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Refreshing instance network info cache due to event network-changed-7c8aa519-69aa-427f-897e-70b8970668b3. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] Acquiring lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] Acquired lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Refreshing network info cache for port 7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Ignoring supplied device name: /dev/vdb
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:54:51 user nova-compute[70375]: INFO nova.compute.manager [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Attaching volume 09e8145b-2c1b-41bb-9c46-f73545fcb601 to /dev/vdb
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.utils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updated VIF entry in instance network info cache for port 7c8aa519-69aa-427f-897e-70b8970668b3. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updating instance_info_cache with network_info: [{"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9cd75a-aab5-42ee-8d99-075c1bc73444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c6136653-b3b0-4ce0-b0fc-10112ce39f21 req-5dccc384-c2ff-460d-9ffa-84160d3f1f83 service nova] Releasing lock "refresh_cache-f9510c63-82f2-4055-abf6-3de637e27309" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da67b9-ea65-481f-9b9b-ecd68b3ad5d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a173f90f-4f83-4553-a25b-a3ec0cfd61f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112e2d9-d8f8-40ae-ad08-651b9b28aec5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:54:51 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:54:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9e526-5a90-40af-90e5-b6a46a05fedf]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG os_brick.utils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:54:51 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updating existing volume attachment record: 90ecade1-2c4b-4a43-9d9e-8b97c456bb83 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:54:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nODKVTEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:54:58 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:54:58 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:54:58 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1db0c-890c-4bf7-941c-c990eaf88483]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:54:58 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2567e-06b5-4223-a211-f9ccc0019234]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601] added
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3795fa25-42ad-4467-90f6-5e2ada0df5f4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad25158-3886-4a21-a36a-53374b12e12f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nODKVTEd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nODKVTEd" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[498dfb7f-ce8d-4015-8ddd-0bf793e0269f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nODKVTEd'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cff7028-564d-48ae-926c-89678a3d5f93]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19952a-2fb0-45ff-a2a9-6170f1c22236]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6a08a-d037-4850-bce7-35ae16179a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260]
Jul 24 17:54:58 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260] successful.
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbaf78-261b-4946-9825-2374e4c4e7c2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[53660a2f-e209-4ec1-884d-4edc967ee2a3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)
Jul 24 17:54:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86aaded-14e5-4080-921e-4ac4beea996a]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nODKVTEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:54:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23266356662653030', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266356662653030', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:54:59 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:54:59 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:54:59 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:54:59 user nova-compute[70375]:   <serial>09e8145b-2c1b-41bb-9c46-f73545fcb601</serial>
Jul 24 17:54:59 user nova-compute[70375]: </disk>
Jul 24 17:54:59 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] No VIF found with MAC fa:16:3e:03:f9:45, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:54:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-0f7d18dd-4221-4c0f-a5f4-8bed13a29b7f tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.523s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:07 user nova-compute[70375]: INFO nova.compute.manager [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Terminating instance
Jul 24 17:55:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-unplugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-unplugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5b43b91a-da3b-488c-9531-94cecd0b3ae8 req-078c5499-6d46-46ba-9abe-11a16f5d877b service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-unplugged-13da2668-5eab-4063-be21-265d9433e5f8 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Instance destroyed successfully.
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lazy-loading 'resources' on Instance uuid 262e5d9e-034c-4dc6-a777-49cbc2e697a3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-165311063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-165311063',id=15,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3GqI4XSjH6uA1b/xGukt+B/XPXf3EF322VqY/1jJS0ntq5ELXqWCL9Au1tKlUddMdZk7ZKF88fsbBy5FWOki9taqkPHHh+dOz4ErrISHRpXkp7fd50xje2YAdooLRYrA==',key_name='tempest-keypair-2035922549',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3444fa91ae1a496987218fedaf7b5e04',ramdisk_id='',reservation_id='r-b4bl8f5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1218286187',owner_user_name='tempest-TaggedAttachmentsTest-1218286187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb73acfd51b4e1ea6efb319ce639881',uuid=262e5d9e-034c-4dc6-a777-49cbc2e697a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converting VIF {"id": "13da2668-5eab-4063-be21-265d9433e5f8", "address": "fa:16:3e:ac:2c:72", "network": {"id": "790ac31f-9ca3-4a9e-9928-ecbc00233139", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1616649489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3444fa91ae1a496987218fedaf7b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13da2668-5e", "ovs_interfaceid": "13da2668-5eab-4063-be21-265d9433e5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG os_vif [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13da2668-5e, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:08 user nova-compute[70375]: INFO os_vif [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=13da2668-5eab-4063-be21-265d9433e5f8,network=Network(790ac31f-9ca3-4a9e-9928-ecbc00233139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13da2668-5e')
Jul 24 17:55:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Deleting instance files /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3_del
Jul 24 17:55:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Deletion of /opt/stack/data/nova/instances/262e5d9e-034c-4dc6-a777-49cbc2e697a3_del complete
Jul 24 17:55:08 user nova-compute[70375]: INFO nova.compute.manager [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 17:55:08 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:55:08 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:55:09 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:09 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Took 1.04 seconds to deallocate network for instance.
Jul 24 17:55:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-bebdca31-2b17-4c4a-bf83-6ecc772e6dbd req-2f5a4715-49a2-4508-b79e-c5526ba46e82 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-deleted-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:09 user nova-compute[70375]: INFO nova.compute.manager [req-bebdca31-2b17-4c4a-bf83-6ecc772e6dbd req-2f5a4715-49a2-4508-b79e-c5526ba46e82 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Neutron deleted interface 13da2668-5eab-4063-be21-265d9433e5f8; detaching it from the instance and deleting it from the info cache
Jul 24 17:55:09 user nova-compute[70375]: DEBUG nova.network.neutron [req-bebdca31-2b17-4c4a-bf83-6ecc772e6dbd req-2f5a4715-49a2-4508-b79e-c5526ba46e82 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-bebdca31-2b17-4c4a-bf83-6ecc772e6dbd req-2f5a4715-49a2-4508-b79e-c5526ba46e82 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Detach interface failed, port_id=13da2668-5eab-4063-be21-265d9433e5f8, reason: Instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:55:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:10 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Deleted allocations for instance 262e5d9e-034c-4dc6-a777-49cbc2e697a3
Jul 24 17:55:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] Acquiring lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] No waiting events found dispatching network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:10 user nova-compute[70375]: WARNING nova.compute.manager [req-2542714b-5351-4298-9c6d-b0815c923f1c req-669ca1f3-ea44-4898-bb41-8bec369bf858 service nova] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Received unexpected event network-vif-plugged-13da2668-5eab-4063-be21-265d9433e5f8 for instance with vm_state deleted and task_state None.
Jul 24 17:55:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ecaa8cdd-d005-45a5-9be2-be52252d17a4 tempest-TaggedAttachmentsTest-1218286187 tempest-TaggedAttachmentsTest-1218286187-project-member] Lock "262e5d9e-034c-4dc6-a777-49cbc2e697a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.448s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:55:16 user nova-compute[70375]: INFO nova.compute.claims [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Claim successful on node user
Jul 24 17:55:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:55:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.policy [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c1aa740b7404c2e8703488bcd87404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a644d007b4ecdbde7ec4788464675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:55:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Creating image(s)
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk 1073741824" returned: 0 in 0.104s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Successfully created port: a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'migration_context' on Instance uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Successfully updated port: a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-changed-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Refreshing instance network info cache due to event network-changed-a52a9b03-6d63-4b30-9868-e91da7546225. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] Acquiring lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:55:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Instance network_info: |[{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] Acquired lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Refreshing network info cache for port a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Start _get_guest_xml network_info=[{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:55:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:55:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-300805815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-300805815',id=21,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-pg0bn8ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:55:17Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=d5a0ab25-5dc8-481b-9101-98318f72dab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:55:19 user nova-compute[70375]:   <uuid>d5a0ab25-5dc8-481b-9101-98318f72dab5</uuid>
Jul 24 17:55:19 user nova-compute[70375]:   <name>instance-00000015</name>
Jul 24 17:55:19 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:55:19 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:55:19 user nova-compute[70375]:   <metadata>
Jul 24 17:55:19 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:55:19 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-300805815</nova:name>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:55:19</nova:creationTime>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:55:19 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:55:19 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:owner>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 17:55:19 user nova-compute[70375]:       </nova:owner>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:55:19 user nova-compute[70375]:       <nova:ports>
Jul 24 17:55:19 user nova-compute[70375]:         <nova:port uuid="a52a9b03-6d63-4b30-9868-e91da7546225">
Jul 24 17:55:19 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 17:55:19 user nova-compute[70375]:         </nova:port>
Jul 24 17:55:19 user nova-compute[70375]:       </nova:ports>
Jul 24 17:55:19 user nova-compute[70375]:     </nova:instance>
Jul 24 17:55:19 user nova-compute[70375]:   </metadata>
Jul 24 17:55:19 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:55:19 user nova-compute[70375]:     <system>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="serial">d5a0ab25-5dc8-481b-9101-98318f72dab5</entry>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="uuid">d5a0ab25-5dc8-481b-9101-98318f72dab5</entry>
Jul 24 17:55:19 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:55:19 user nova-compute[70375]:     </system>
Jul 24 17:55:19 user nova-compute[70375]:   </sysinfo>
Jul 24 17:55:19 user nova-compute[70375]:   <os>
Jul 24 17:55:19 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:55:19 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:55:19 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:55:19 user nova-compute[70375]:   </os>
Jul 24 17:55:19 user nova-compute[70375]:   <features>
Jul 24 17:55:19 user nova-compute[70375]:     <acpi/>
Jul 24 17:55:19 user nova-compute[70375]:     <apic/>
Jul 24 17:55:19 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:55:19 user nova-compute[70375]:   </features>
Jul 24 17:55:19 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:55:19 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:55:19 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:55:19 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:55:19 user nova-compute[70375]:   </clock>
Jul 24 17:55:19 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:55:19 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:55:19 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:55:19 user nova-compute[70375]:   </cpu>
Jul 24 17:55:19 user nova-compute[70375]:   <devices>
Jul 24 17:55:19 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:55:19 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:55:19 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk"/>
Jul 24 17:55:19 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:55:19 user nova-compute[70375]:     </disk>
Jul 24 17:55:19 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:55:19 user nova-compute[70375]:       <mac address="fa:16:3e:d0:2d:a7"/>
Jul 24 17:55:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:55:19 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:55:19 user nova-compute[70375]:       <target dev="tapa52a9b03-6d"/>
Jul 24 17:55:19 user nova-compute[70375]:     </interface>
Jul 24 17:55:19 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:55:19 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/console.log" append="off"/>
Jul 24 17:55:19 user nova-compute[70375]:     </serial>
Jul 24 17:55:19 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:55:19 user nova-compute[70375]:     <video>
Jul 24 17:55:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:55:19 user nova-compute[70375]:     </video>
Jul 24 17:55:19 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:55:19 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:55:19 user nova-compute[70375]:     </rng>
Jul 24 17:55:19 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:55:19 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:55:19 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:55:19 user nova-compute[70375]:     </memballoon>
Jul 24 17:55:19 user nova-compute[70375]:   </devices>
Jul 24 17:55:19 user nova-compute[70375]: </domain>
Jul 24 17:55:19 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-300805815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-300805815',id=21,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-pg0bn8ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:55:17Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=d5a0ab25-5dc8-481b-9101-98318f72dab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG os_vif [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa52a9b03-6d, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa52a9b03-6d, col_values=(('external_ids', {'iface-id': 'a52a9b03-6d63-4b30-9868-e91da7546225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:2d:a7', 'vm-uuid': 'd5a0ab25-5dc8-481b-9101-98318f72dab5'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:19 user nova-compute[70375]: INFO os_vif [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d')
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:d0:2d:a7, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updated VIF entry in instance network info cache for port a52a9b03-6d63-4b30-9868-e91da7546225. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-816b1881-3fc0-4bb9-bd19-bdfb4ae4eadb req-05136550-0646-4f1e-828b-aed1be288981 service nova] Releasing lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] No waiting events found dispatching network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:20 user nova-compute[70375]: WARNING nova.compute.manager [req-7071a030-e2d5-4abe-8d68-a905984c67ba req-691472ab-acd0-47c4-9a01-8f704c8ec103 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received unexpected event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 for instance with vm_state building and task_state spawning.
Jul 24 17:55:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221322.734512, d5a0ab25-5dc8-481b-9101-98318f72dab5 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] VM Resumed (Lifecycle Event)
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Instance spawned successfully.
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221322.7393556, d5a0ab25-5dc8-481b-9101-98318f72dab5 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] VM Started (Lifecycle Event)
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] No waiting events found dispatching network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:22 user nova-compute[70375]: WARNING nova.compute.manager [req-568272e3-d4ed-4c22-825e-8cebaf5dd4fa req-e70bd2d2-95f5-4d94-b3b5-ce5502b3e7a0 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received unexpected event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 for instance with vm_state building and task_state spawning.
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Took 5.60 seconds to spawn the instance on the hypervisor.
Jul 24 17:55:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:22 user nova-compute[70375]: INFO nova.compute.manager [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Took 6.31 seconds to build instance.
Jul 24 17:55:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8c6d5dfc-59ca-47cf-9df1-1220433216bd tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:23 user nova-compute[70375]: INFO nova.compute.manager [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Detaching volume 09e8145b-2c1b-41bb-9c46-f73545fcb601
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221308.7302341, 262e5d9e-034c-4dc6-a777-49cbc2e697a3 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:55:23 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] VM Stopped (Lifecycle Event)
Jul 24 17:55:23 user nova-compute[70375]: INFO nova.virt.block_device [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Attempting to driver detach volume 09e8145b-2c1b-41bb-9c46-f73545fcb601 from mountpoint /dev/vdb
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Attempting to detach device vdb from instance f9510c63-82f2-4055-abf6-3de637e27309 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:55:23 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:55:23 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:55:23 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:55:23 user nova-compute[70375]:   <serial>09e8145b-2c1b-41bb-9c46-f73545fcb601</serial>
Jul 24 17:55:23 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:55:23 user nova-compute[70375]: </disk>
Jul 24 17:55:23 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-101566df-e7be-445b-bb09-7adcc21a5153 None None] [instance: 262e5d9e-034c-4dc6-a777-49cbc2e697a3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:23 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully detached device vdb from instance f9510c63-82f2-4055-abf6-3de637e27309 from the persistent domain config.
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9510c63-82f2-4055-abf6-3de637e27309 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:55:23 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:55:23 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 17:55:23 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:55:23 user nova-compute[70375]:   <serial>09e8145b-2c1b-41bb-9c46-f73545fcb601</serial>
Jul 24 17:55:23 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:55:23 user nova-compute[70375]: </disk>
Jul 24 17:55:23 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:55:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221324.2724113, f9510c63-82f2-4055-abf6-3de637e27309 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:55:24 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully detached device vdb from instance f9510c63-82f2-4055-abf6-3de637e27309 from the live domain config.
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nODKVTEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:55:24 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a0905-434a-4a03-89b2-7a114126a0ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:55:24 user nova-compute[70375]: No targets found.
Jul 24 17:55:24 user nova-compute[70375]: iSNS:
Jul 24 17:55:24 user nova-compute[70375]: No targets found.
Jul 24 17:55:24 user nova-compute[70375]: STATIC:
Jul 24 17:55:24 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c
Jul 24 17:55:24 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:24 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:24 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601
Jul 24 17:55:24 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:24 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:24 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:55:24 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:24 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:24 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0
Jul 24 17:55:24 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:24 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:24 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:55:24 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:24 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:24 user nova-compute[70375]: FIRMWARE:
Jul 24 17:55:24 user nova-compute[70375]: No targets found.
Jul 24 17:55:24 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:55:24 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:55:24 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0094ed0-16aa-4735-96a8-abc5fc1450aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[557bade8-9f60-476a-b055-1d6ec05fe12f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 (non-flash)
Jul 24 17:55:24 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe65009c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7287cb-55c3-4c90-a51a-59aa1021ee5c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e7a9e5-d881-43dd-b570-b4c3b33ba67d]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f963d0-a35f-4022-b70d-f3bb0e29bde1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2a211a-97b3-430d-bdc2-1113971fe003]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd18b9a-baf1-42f7-b984-0c461cb77e18]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdf596-fef6-4637-a5f5-4b4366d2e183]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260]
Jul 24 17:55:24 user nova-compute[70375]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601, portal: 172.16.0.220,3260] successful.
Jul 24 17:55:24 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d0069-ba9d-4c7d-b73a-e40784819b4d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== disconnect_volume: return (324ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-changed-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing instance network info cache due to event network-changed-04ddbcba-2231-47d5-bf3e-7e82a728169e. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] Acquiring lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] Acquired lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:55:24 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Refreshing network info cache for port 04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.objects.instance [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'flavor' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updated VIF entry in instance network info cache for port 04ddbcba-2231-47d5-bf3e-7e82a728169e. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-861c3ca8-b60b-425f-aa0a-8b8dad342a75 tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.939s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.739s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:25 user nova-compute[70375]: INFO nova.compute.manager [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Terminating instance
Jul 24 17:55:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7e7abbc-0817-47b1-a4e9-342ab1110647 req-5f2a808a-4531-4ede-b4cc-23c7c56ae618 service nova] Releasing lock "refresh_cache-e4c27005-3977-475c-ad11-5fd13b9e7a2e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Instance destroyed successfully.
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lazy-loading 'resources' on Instance uuid f9510c63-82f2-4055-abf6-3de637e27309 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-9728462',display_name='tempest-VolumesSnapshotTestJSON-instance-9728462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-9728462',id=17,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1aVaWl2UvmcCXSCVSuwwax5jWpQX78ITUxfU0izra8yGeUg1yVblGHbnUOfv611Xw/sjRKHg12hsvq4y7J/d9ltm2kSYKjliZO/A5mx5EA47rRBJShIYOdxYL3bLwFsg==',key_name='tempest-keypair-1509136975',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941f5e68e0c44a5f890f0901df3b71b6',ramdisk_id='',reservation_id='r-1ya1zsfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2081775558',owner_user_name='tempest-VolumesSnapshotTestJSON-2081775558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a249d8642e364aa09f5d9e5578a30567',uuid=f9510c63-82f2-4055-abf6-3de637e27309,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converting VIF {"id": "7c8aa519-69aa-427f-897e-70b8970668b3", "address": "fa:16:3e:03:f9:45", "network": {"id": "467c9c37-5c66-45ea-b977-47e50dd88360", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2055003062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941f5e68e0c44a5f890f0901df3b71b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8aa519-69", "ovs_interfaceid": "7c8aa519-69aa-427f-897e-70b8970668b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_vif [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c8aa519-69, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:26 user nova-compute[70375]: INFO os_vif [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:f9:45,bridge_name='br-int',has_traffic_filtering=True,id=7c8aa519-69aa-427f-897e-70b8970668b3,network=Network(467c9c37-5c66-45ea-b977-47e50dd88360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8aa519-69')
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nODKVTEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:55:26 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b8a26-62f5-4ad2-bc02-eb8764d8eaa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:55:26 user nova-compute[70375]: No targets found.
Jul 24 17:55:26 user nova-compute[70375]: iSNS:
Jul 24 17:55:26 user nova-compute[70375]: No targets found.
Jul 24 17:55:26 user nova-compute[70375]: STATIC:
Jul 24 17:55:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c
Jul 24 17:55:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:55:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0
Jul 24 17:55:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:26 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:55:26 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:26 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:26 user nova-compute[70375]: FIRMWARE:
Jul 24 17:55:26 user nova-compute[70375]: No targets found.
Jul 24 17:55:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:55:26 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:55:26 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e8145b-2c1b-41bb-9c46-f73545fcb601', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da16a5-5990-4916-8f11-61edb71030ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3822d05-0b22-4d1d-a39e-994a226de27d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:26 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650190670>, {}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Disconnecting from: [] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] <== disconnect_volume: return (81ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:55:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Deleting instance files /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309_del
Jul 24 17:55:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Deletion of /opt/stack/data/nova/instances/f9510c63-82f2-4055-abf6-3de637e27309_del complete
Jul 24 17:55:26 user nova-compute[70375]: INFO nova.compute.manager [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-unplugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] No waiting events found dispatching network-vif-unplugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-unplugged-7c8aa519-69aa-427f-897e-70b8970668b3 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Acquiring lock "f9510c63-82f2-4055-abf6-3de637e27309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] Lock "f9510c63-82f2-4055-abf6-3de637e27309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] No waiting events found dispatching network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:26 user nova-compute[70375]: WARNING nova.compute.manager [req-b86c2db0-b6a6-4b51-9bbc-c967d40fae61 req-3d099e71-b1c8-4f39-b8b5-003dd8dc8e2a service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received unexpected event network-vif-plugged-7c8aa519-69aa-427f-897e-70b8970668b3 for instance with vm_state active and task_state deleting.
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:26 user nova-compute[70375]: INFO nova.compute.manager [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Terminating instance
Jul 24 17:55:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-2b877dad-ca0f-4d45-9ad7-9119a7826f38 req-51d8afbb-ebd9-4019-be09-af4e599e6526 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-65bb0d6f-aef7-4c1d-aa55-aef86b78c441 req-65c72004-ca75-4a21-bbb2-487b5c274510 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:28 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Took 1.45 seconds to deallocate network for instance.
Jul 24 17:55:28 user nova-compute[70375]: WARNING nova.volume.cinder [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Attachment 90ecade1-2c4b-4a43-9d9e-8b97c456bb83 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 90ecade1-2c4b-4a43-9d9e-8b97c456bb83. (HTTP 404) (Request-ID: req-0b33876d-c7df-4d3f-9fc1-0937eaec8437)
Jul 24 17:55:28 user nova-compute[70375]: INFO nova.compute.manager [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Took 0.03 seconds to detach 1 volumes for instance.
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Deleted allocations for instance f9510c63-82f2-4055-abf6-3de637e27309
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c80a5467-4b64-43b6-b4ca-c04b7364c7cf tempest-VolumesSnapshotTestJSON-2081775558 tempest-VolumesSnapshotTestJSON-2081775558-project-member] Lock "f9510c63-82f2-4055-abf6-3de637e27309" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Instance destroyed successfully.
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lazy-loading 'resources' on Instance uuid e4c27005-3977-475c-ad11-5fd13b9e7a2e {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ddbcba-22, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-04ddbcba-2231-47d5-bf3e-7e82a728169e for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: WARNING nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-04ddbcba-2231-47d5-bf3e-7e82a728169e for instance with vm_state active and task_state deleting.
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-7e8f0011-a379-4605-b74a-febf1e0ad798 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: WARNING nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-7e8f0011-a379-4605-b74a-febf1e0ad798 for instance with vm_state active and task_state deleting.
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-22f8211e-1dbd-451f-994d-cf2a32825495 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:28 user nova-compute[70375]: WARNING nova.compute.manager [req-ab7893e8-6431-4baa-b035-60d9ab70aabd req-62c40c69-e132-4e16-b76b-badeb5c70094 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-22f8211e-1dbd-451f-994d-cf2a32825495 for instance with vm_state active and task_state deleting.
Jul 24 17:55:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:12:31,bridge_name='br-int',has_traffic_filtering=True,id=04ddbcba-2231-47d5-bf3e-7e82a728169e,network=Network(494ef85a-e0a7-46a7-b579-f8c19d2cd3ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ddbcba-22')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37599ee2-d3, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:ce,bridge_name='br-int',has_traffic_filtering=True,id=37599ee2-d38d-495a-86c3-42c5663a2bb8,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37599ee2-d3')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8f0011-a3, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ae:85,bridge_name='br-int',has_traffic_filtering=True,id=7e8f0011-a379-4605-b74a-febf1e0ad798,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8f0011-a3')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbb84c41-2b, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bb:42,bridge_name='br-int',has_traffic_filtering=True,id=cbb84c41-2bd6-41d0-ae43-13324a6503d9,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb84c41-2b')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22f8211e-1d, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:02:e6,bridge_name='br-int',has_traffic_filtering=True,id=22f8211e-1dbd-451f-994d-cf2a32825495,network=Network(a1a49827-11b0-432a-bd7e-9b985ccc78fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f8211e-1d')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape81a213a-7f, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=e81a213a-7fa4-495f-9e06-ad06e4e61973,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81a213a-7f')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T17:53:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2001750488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2001750488',id=18,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nQfXZ32AMcSa36Yfmj5DNjzkvs0RfSQN/T8AuItGt0Z5Bgb9fmyAWIk0p4ITnpvQTDMPxSO8g3n06Irzz9FXlpmIO2Kf41ejtbpvJZTX5vxKnOwo+diKyKzW5IrZJFg==',key_name='tempest-keypair-1704798556',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='695cd522a9364c03979befc8c8ded313',ramdisk_id='',reservation_id='r-fg11a3en',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1417328943',owner_user_name='tempest-TaggedBootDevicesTest-1417328943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e5e89ecdce7447397bc313eb057251d',uuid=e4c27005-3977-475c-ad11-5fd13b9e7a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converting VIF {"id": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "address": "fa:16:3e:29:cd:65", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba626e-94", "ovs_interfaceid": "66ba626e-9419-4b79-9653-c3c1d3e38bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66ba626e-94, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:29 user nova-compute[70375]: INFO os_vif [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:cd:65,bridge_name='br-int',has_traffic_filtering=True,id=66ba626e-9419-4b79-9653-c3c1d3e38bcb,network=Network(6edade30-a283-4830-8d3a-c7507d89537e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba626e-94')
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYTlHezZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b25dd-2f61-4807-982b-2f8216b423f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: iSNS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: STATIC:
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: FIRMWARE:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:55:29 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13beca75-78e1-47fe-85e8-8123c4b3be2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf9b0c7-7f10-424a-9269-9b60ae6716e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650389f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9823c-70e1-4231-9bff-06d92e7f6faf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b5bc8-0875-487a-8b0f-d767b6467365]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc751d40-a7f5-4706-b092-5dd3eeae6cfc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[14139617-5fa2-4e15-bd00-6e299871305f]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c342ffdc-e676-410f-a92d-e29cfaa272a1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[942247f6-fc32-4760-a19d-3557f12df236]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260]
Jul 24 17:55:29 user nova-compute[70375]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0, portal: 172.16.0.220,3260] successful.
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667aaf05-a6da-453d-982d-4630d6c39df0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[63feb61b-7cff-4b51-9500-597425974ed7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== disconnect_volume: return (322ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwRVurA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b0319-ddb4-4a2f-bd95-1035fc963e22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: iSNS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: STATIC:
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: FIRMWARE:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:55:29 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2dbb34-c83d-43f0-baba-6234702b3716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ddb50-4ec4-46dd-b3be-d3e65b30bd78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650389f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[452be5a6-4a4b-4e62-9766-15205d754f28]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec213e97-a989-4f40-825a-b2f78ea4de6b]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7bfff-fd85-4269-9a05-86e907382776]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b63cf8-b0f8-4d41-bed2-1e9418b39266]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc14cde-b635-4627-b69e-cc7c768a2c52]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING nova.compute.manager [req-8901efbd-16f6-4460-a447-66c4205640d3 req-53dd8660-1032-4460-8b23-271cf0baabb9 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-cbb84c41-2bd6-41d0-ae43-13324a6503d9 for instance with vm_state active and task_state deleting.
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea184fa-9350-45df-a6fc-5fa3a5e62a0f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260]
Jul 24 17:55:29 user nova-compute[70375]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c, portal: 172.16.0.220,3260] successful.
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63a7b15-4bfb-4a3e-898a-c25c1949e59c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e3525-6479-4f7a-b399-afa4069b8509]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== disconnect_volume: return (295ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olSZYEGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeedd20-9682-4745-bf3e-9d272cd8560d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: iSNS:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]: STATIC:
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:55:29 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:55:29 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:55:29 user nova-compute[70375]: FIRMWARE:
Jul 24 17:55:29 user nova-compute[70375]: No targets found.
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:55:29 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:55:29 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd37f426-fe1a-421a-85b3-9bceb4fe4bfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b8bba-12d2-4a7f-8e6f-3f586654a467]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 (non-flash)
Jul 24 17:55:29 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650280700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Received event network-vif-deleted-7c8aa519-69aa-427f-897e-70b8970668b3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-37599ee2-d38d-495a-86c3-42c5663a2bb8 for instance with vm_state active and task_state deleting.
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:29 user nova-compute[70375]: WARNING nova.compute.manager [req-3e4545b9-b551-4e0c-a555-4875eceda499 req-927d01f6-0324-4c26-8c72-3a0b8221482b service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-e81a213a-7fa4-495f-9e06-ad06e4e61973 for instance with vm_state active and task_state deleting.
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ccdf65-ff63-466a-bbfa-067701df52a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1508402-f980-4428-a4cc-af2669a278e7]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f021532-a1b0-4289-9bef-c99e8e09746e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d57fc34-49f9-42c2-a398-776c5cbd2eb3]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[340877ad-1a78-453c-833b-7deb97036cc4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f490bd8-ef49-458e-912a-c2952a34c33c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260]
Jul 24 17:55:30 user nova-compute[70375]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3, portal: 172.16.0.220,3260] successful.
Jul 24 17:55:30 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff0f79b-315a-47d5-9224-395b233314f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75fe1e-8d67-42d8-b1e9-a8395932eddd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] <== disconnect_volume: return (287ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:55:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Deleting instance files /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e_del
Jul 24 17:55:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Deletion of /opt/stack/data/nova/instances/e4c27005-3977-475c-ad11-5fd13b9e7a2e_del complete
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:55:30 user nova-compute[70375]: INFO nova.compute.manager [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Took 3.27 seconds to destroy the instance on the hypervisor.
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-unplugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-unplugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Acquiring lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] No waiting events found dispatching network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:55:31 user nova-compute[70375]: WARNING nova.compute.manager [req-a1084571-b104-4950-91a3-a30cfc170f1b req-f2868004-a73a-4b34-9880-1a66b6a921c2 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received unexpected event network-vif-plugged-66ba626e-9419-4b79-9653-c3c1d3e38bcb for instance with vm_state active and task_state deleting.
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-559dfa2c-e757-4689-8c66-0309392a1a7d req-6f40d0d9-bcfc-464b-a3ed-1063395395e1 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-deleted-66ba626e-9419-4b79-9653-c3c1d3e38bcb {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:32 user nova-compute[70375]: INFO nova.compute.manager [req-559dfa2c-e757-4689-8c66-0309392a1a7d req-6f40d0d9-bcfc-464b-a3ed-1063395395e1 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Neutron deleted interface 66ba626e-9419-4b79-9653-c3c1d3e38bcb; detaching it from the instance and deleting it from the info cache
Jul 24 17:55:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-559dfa2c-e757-4689-8c66-0309392a1a7d req-6f40d0d9-bcfc-464b-a3ed-1063395395e1 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "address": "fa:16:3e:36:72:4a", "network": {"id": "6edade30-a283-4830-8d3a-c7507d89537e", "bridge": "br-int", "label": "tempest-device-tagging-net2-386840176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81a213a-7f", "ovs_interfaceid": "e81a213a-7fa4-495f-9e06-ad06e4e61973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-559dfa2c-e757-4689-8c66-0309392a1a7d req-6f40d0d9-bcfc-464b-a3ed-1063395395e1 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Detach interface failed, port_id=66ba626e-9419-4b79-9653-c3c1d3e38bcb, reason: Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:55:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:55:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:55:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7748MB free_disk=24.511619567871094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f377f3ff-db0f-40f5-b183-e493a90c0e9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:55:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-deleted-e81a213a-7fa4-495f-9e06-ad06e4e61973 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:34 user nova-compute[70375]: INFO nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Neutron deleted interface e81a213a-7fa4-495f-9e06-ad06e4e61973; detaching it from the instance and deleting it from the info cache
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "address": "fa:16:3e:3a:12:31", "network": {"id": "494ef85a-e0a7-46a7-b579-f8c19d2cd3ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1481658102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ddbcba-22", "ovs_interfaceid": "04ddbcba-2231-47d5-bf3e-7e82a728169e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Detach interface failed, port_id=e81a213a-7fa4-495f-9e06-ad06e4e61973, reason: Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-deleted-04ddbcba-2231-47d5-bf3e-7e82a728169e {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:34 user nova-compute[70375]: INFO nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Neutron deleted interface 04ddbcba-2231-47d5-bf3e-7e82a728169e; detaching it from the instance and deleting it from the info cache
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [{"id": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "address": "fa:16:3e:92:c7:ce", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37599ee2-d3", "ovs_interfaceid": "37599ee2-d38d-495a-86c3-42c5663a2bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8f0011-a379-4605-b74a-febf1e0ad798", "address": "fa:16:3e:e8:ae:85", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8f0011-a3", "ovs_interfaceid": "7e8f0011-a379-4605-b74a-febf1e0ad798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "address": "fa:16:3e:a3:bb:42", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb84c41-2b", "ovs_interfaceid": "cbb84c41-2bd6-41d0-ae43-13324a6503d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22f8211e-1dbd-451f-994d-cf2a32825495", "address": "fa:16:3e:99:02:e6", "network": {"id": "a1a49827-11b0-432a-bd7e-9b985ccc78fc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1652611492", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "695cd522a9364c03979befc8c8ded313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f8211e-1d", "ovs_interfaceid": "22f8211e-1dbd-451f-994d-cf2a32825495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-efb0fc9c-c9d1-4c1e-8fb6-17320c3c5f40 req-502594ee-379d-4d66-93cb-e4b8f7c0aaa4 service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Detach interface failed, port_id=04ddbcba-2231-47d5-bf3e-7e82a728169e, reason: Instance e4c27005-3977-475c-ad11-5fd13b9e7a2e could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:55:35 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:55:35 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Took 4.79 seconds to deallocate network for instance.
Jul 24 17:55:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-3626a8b2-e847-48e2-aa31-0752bb015429 req-f52561bb-4885-447e-aef1-9ef35954445e service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-deleted-22f8211e-1dbd-451f-994d-cf2a32825495 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-3626a8b2-e847-48e2-aa31-0752bb015429 req-f52561bb-4885-447e-aef1-9ef35954445e service nova] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Received event network-vif-deleted-cbb84c41-2bd6-41d0-ae43-13324a6503d9 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:55:37 user nova-compute[70375]: INFO nova.compute.manager [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Took 2.28 seconds to detach 3 volumes for instance.
Jul 24 17:55:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:55:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:55:37 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:55:37 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:55:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:37 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Deleted allocations for instance e4c27005-3977-475c-ad11-5fd13b9e7a2e
Jul 24 17:55:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7bd2878b-f61f-4119-a3ce-cf5a62015e35 tempest-TaggedBootDevicesTest-1417328943 tempest-TaggedBootDevicesTest-1417328943-project-member] Lock "e4c27005-3977-475c-ad11-5fd13b9e7a2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.766s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:55:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:55:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:41 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221326.3525002, f9510c63-82f2-4055-abf6-3de637e27309 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:55:41 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f9510c63-82f2-4055-abf6-3de637e27309] VM Stopped (Lifecycle Event)
Jul 24 17:55:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-359ba039-799e-4452-9d35-52d2a8948907 None None] [instance: f9510c63-82f2-4055-abf6-3de637e27309] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:43 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221328.9122138, e4c27005-3977-475c-ad11-5fd13b9e7a2e => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:55:43 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] VM Stopped (Lifecycle Event)
Jul 24 17:55:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a3fd93b1-f9c0-4b7b-8198-d4b3a3b8f11c None None] [instance: e4c27005-3977-475c-ad11-5fd13b9e7a2e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:55:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:55:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'flavor' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:02 user nova-compute[70375]: INFO nova.compute.manager [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attaching volume 78cff04d-f365-4b90-9b96-37b556e2c234 to /dev/vdb
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.utils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf85603-45f0-4a93-91de-6d681efd0df4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d453ba-d764-4027-aff1-d508c3bdf336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ac377-fcd6-46bc-972f-579892a5ecd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd3e801-8e7e-4090-9e55-23cb0b383394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:02 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:56:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d3b40-82c7-401f-b7c9-e250fb2071c6]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG os_brick.utils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:02 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating existing volume attachment record: e6e5f4c4-09b0-4b83-862f-d3a665495ed8 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:56:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-changed-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Refreshing instance network info cache due to event network-changed-6abab823-a389-4e32-b881-b5848e321a1d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:56:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] Acquiring lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:56:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] Acquired lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:56:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Refreshing network info cache for port 6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:56:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:56:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updated VIF entry in instance network info cache for port 6abab823-a389-4e32-b881-b5848e321a1d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:56:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b88d9568-dc70-482a-b24e-a168c8ea4b8f req-fee243b8-3651-4483-acfe-a81038d0337d service nova] Releasing lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:56:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:07 user nova-compute[70375]: INFO nova.compute.manager [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attaching volume 5d21e633-d7c7-4186-84b2-ecb43852026b to /dev/vdb
Jul 24 17:56:07 user nova-compute[70375]: DEBUG os_brick.utils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[198b7530-d327-4f13-887a-14ee8e419edf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0fb95-0d28-4e22-b85d-e78b3626ff24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dff29c3-ec79-4c88-aecf-c2e127bdfa40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab60f43-aa9e-437c-a362-06191a5f4e54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:08 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ecbfd9-d995-4516-a43a-872eb1891bab]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG os_brick.utils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating existing volume attachment record: c96cc49e-d647-47bd-a52b-5d24a283e69e {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:08 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:56:08 user nova-compute[70375]: INFO nova.compute.claims [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Claim successful on node user
Jul 24 17:56:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:56:09 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:56:09 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Creating image(s)
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.policy [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a4f4aec1664e07b1d57a7848c02498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2983b563c19040dfbec3b2c10ce2d14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:09 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:09 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:09 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a45f06-3219-437c-a026-5ba1c0928f12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:56:09 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057783c-7249-496d-be8e-e95194990f81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234] added
Jul 24 17:56:09 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad918e-5cba-4bb9-9f8b-8f44d0c64ba9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5052caef-3af5-47bc-aead-842ac7e3050d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMzQmxI {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk 1073741824" returned: 0 in 0.050s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMzQmxI" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4ad47-e08c-4beb-973a-99680af9e503]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrMzQmxI'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[930461d0-209b-4c3a-964a-9aa4fe35ab11]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7388c0-7106-42de-b69c-e8934fec804b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:09 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:09 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d2177-4f08-47de-b4f8-40c85ded0fa4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]
Jul 24 17:56:10 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6151ce5-248e-4cc0-a22c-bffc264bca45]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc06fc6b-d1ec-4a6e-9579-921ad5d836ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:10 user nova-compute[70375]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:10 user nova-compute[70375]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:10 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[094befdf-b2f8-45c2-ba30-04826f3e3a4e]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Cannot resize image /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Ensure instance console log exists: /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Successfully created port: 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Successfully updated port: 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing instance network info cache due to event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26662356331616666', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662356331616666', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'flavor' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:56:11 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:11 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:56:11 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:11 user nova-compute[70375]:   <serial>78cff04d-f365-4b90-9b96-37b556e2c234</serial>
Jul 24 17:56:11 user nova-compute[70375]: </disk>
Jul 24 17:56:11 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance network_info: |[{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.neutron [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start _get_guest_xml network_info=[{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:56:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:56:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-455018711',display_name='tempest-ServerRescueNegativeTestJSON-server-455018711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-455018711',id=22,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+8SRWG8T879MTkJiAHYD9M7E41i9CLX+vusUYAP34t9JA4nlLHTCzh7iAF8gyma58NeSrVAG4czVm/LUYJuauLp7OYHrWzE77OIf/Q7JjWeXUYMLskrjBdCVxJ5Yq53g==',key_name='tempest-keypair-1631665804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-yjbhp7to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=cc5ce8b4-e6f3-4af1-a829-7883fac5847f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:56:11 user nova-compute[70375]:   <uuid>cc5ce8b4-e6f3-4af1-a829-7883fac5847f</uuid>
Jul 24 17:56:11 user nova-compute[70375]:   <name>instance-00000016</name>
Jul 24 17:56:11 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:56:11 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:56:11 user nova-compute[70375]:   <metadata>
Jul 24 17:56:11 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:56:11 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-455018711</nova:name>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:56:11</nova:creationTime>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:56:11 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:56:11 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:owner>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:56:11 user nova-compute[70375]:       </nova:owner>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:56:11 user nova-compute[70375]:       <nova:ports>
Jul 24 17:56:11 user nova-compute[70375]:         <nova:port uuid="08be5745-5810-4b4d-b53c-5efb8aee4493">
Jul 24 17:56:11 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 17:56:11 user nova-compute[70375]:         </nova:port>
Jul 24 17:56:11 user nova-compute[70375]:       </nova:ports>
Jul 24 17:56:11 user nova-compute[70375]:     </nova:instance>
Jul 24 17:56:11 user nova-compute[70375]:   </metadata>
Jul 24 17:56:11 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:56:11 user nova-compute[70375]:     <system>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="serial">cc5ce8b4-e6f3-4af1-a829-7883fac5847f</entry>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="uuid">cc5ce8b4-e6f3-4af1-a829-7883fac5847f</entry>
Jul 24 17:56:11 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:56:11 user nova-compute[70375]:     </system>
Jul 24 17:56:11 user nova-compute[70375]:   </sysinfo>
Jul 24 17:56:11 user nova-compute[70375]:   <os>
Jul 24 17:56:11 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:56:11 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:56:11 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:56:11 user nova-compute[70375]:   </os>
Jul 24 17:56:11 user nova-compute[70375]:   <features>
Jul 24 17:56:11 user nova-compute[70375]:     <acpi/>
Jul 24 17:56:11 user nova-compute[70375]:     <apic/>
Jul 24 17:56:11 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:56:11 user nova-compute[70375]:   </features>
Jul 24 17:56:11 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:56:11 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:56:11 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:56:11 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:56:11 user nova-compute[70375]:   </clock>
Jul 24 17:56:11 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:56:11 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:56:11 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:56:11 user nova-compute[70375]:   </cpu>
Jul 24 17:56:11 user nova-compute[70375]:   <devices>
Jul 24 17:56:11 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:56:11 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:56:11 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk"/>
Jul 24 17:56:11 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:56:11 user nova-compute[70375]:     </disk>
Jul 24 17:56:11 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:56:11 user nova-compute[70375]:       <mac address="fa:16:3e:07:ee:a1"/>
Jul 24 17:56:11 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:56:11 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:56:11 user nova-compute[70375]:       <target dev="tap08be5745-58"/>
Jul 24 17:56:11 user nova-compute[70375]:     </interface>
Jul 24 17:56:11 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:56:11 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/console.log" append="off"/>
Jul 24 17:56:11 user nova-compute[70375]:     </serial>
Jul 24 17:56:11 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:56:11 user nova-compute[70375]:     <video>
Jul 24 17:56:11 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:56:11 user nova-compute[70375]:     </video>
Jul 24 17:56:11 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:56:11 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:56:11 user nova-compute[70375]:     </rng>
Jul 24 17:56:11 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:56:11 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:56:11 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:56:11 user nova-compute[70375]:     </memballoon>
Jul 24 17:56:11 user nova-compute[70375]:   </devices>
Jul 24 17:56:11 user nova-compute[70375]: </domain>
Jul 24 17:56:11 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-455018711',display_name='tempest-ServerRescueNegativeTestJSON-server-455018711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-455018711',id=22,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+8SRWG8T879MTkJiAHYD9M7E41i9CLX+vusUYAP34t9JA4nlLHTCzh7iAF8gyma58NeSrVAG4czVm/LUYJuauLp7OYHrWzE77OIf/Q7JjWeXUYMLskrjBdCVxJ5Yq53g==',key_name='tempest-keypair-1631665804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-yjbhp7to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=cc5ce8b4-e6f3-4af1-a829-7883fac5847f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG os_vif [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08be5745-58, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08be5745-58, col_values=(('external_ids', {'iface-id': '08be5745-5810-4b4d-b53c-5efb8aee4493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:ee:a1', 'vm-uuid': 'cc5ce8b4-e6f3-4af1-a829-7883fac5847f'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:11 user nova-compute[70375]: INFO os_vif [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58')
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:07:ee:a1, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No VIF found with MAC fa:16:3e:19:ad:ce, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:56:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-66c1750c-e42a-4074-af0e-be395a216ea4 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.381s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updated VIF entry in instance network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8bc3a6c-13af-46a3-b1d3-90b25542c41b req-1a3a6ae9-036f-4815-8cb8-f604ac604f86 service nova] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:13 user nova-compute[70375]: WARNING nova.compute.manager [req-90c10b03-0acd-49b6-9992-0be9a8608da2 req-9f2f5fb2-7c2e-4824-930f-ea1f9a38b5b8 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state building and task_state spawning.
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-changed-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Refreshing instance network info cache due to event network-changed-57a5dc5d-5db6-437b-8579-def74159e777. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] Acquiring lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] Acquired lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Refreshing network info cache for port 57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:56:13 user nova-compute[70375]: INFO nova.compute.manager [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Rebuilding instance
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_requests' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_devices' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'resources' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'migration_context' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70375) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.network.neutron [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updated VIF entry in instance network info cache for port 57a5dc5d-5db6-437b-8579-def74159e777. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.network.neutron [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updating instance_info_cache with network_info: [{"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ccd41085-a77b-4255-8457-8779c64cac8f req-9ea7db9d-36b7-420d-8942-e78209c973ad service nova] Releasing lock "refresh_cache-f377f3ff-db0f-40f5-b183-e493a90c0e9b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:56:14 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance destroyed successfully.
Jul 24 17:56:14 user nova-compute[70375]: INFO nova.compute.manager [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Detaching volume 78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:56:14 user nova-compute[70375]: INFO nova.virt.block_device [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attempting to driver detach volume 78cff04d-f365-4b90-9b96-37b556e2c234 from mountpoint /dev/vdb
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Attempting to detach device vdb from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:56:14 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:14 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:56:14 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:14 user nova-compute[70375]:   <serial>78cff04d-f365-4b90-9b96-37b556e2c234</serial>
Jul 24 17:56:14 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:56:14 user nova-compute[70375]: </disk>
Jul 24 17:56:14 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:56:14 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully detached device vdb from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the persistent domain config.
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:14 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d681db1-a14d-4fc8-96ac-93d0e24da77d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:56:14 user nova-compute[70375]: No targets found.
Jul 24 17:56:14 user nova-compute[70375]: iSNS:
Jul 24 17:56:14 user nova-compute[70375]: No targets found.
Jul 24 17:56:14 user nova-compute[70375]: STATIC:
Jul 24 17:56:14 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:56:14 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:14 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:14 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:56:14 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:14 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:14 user nova-compute[70375]: FIRMWARE:
Jul 24 17:56:14 user nova-compute[70375]: No targets found.
Jul 24 17:56:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:56:14 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:56:14 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1e263-407a-443a-8fe3-71c78d64350a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff50a9cf-14eb-4b8c-8806-3720fd4e078c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:14 user nova-compute[70375]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:14 user nova-compute[70375]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:14 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe648389e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPDxuUhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:14 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f4512-7cdf-4647-955c-6715d04a7c0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:14 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2fa829-8270-47e8-a12b-67af68977abc]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2030adf-e911-4308-bb2a-3a673c76281c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b68c9f-0453-46ae-b4ca-bec1fb6939e0]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7b2180-59d9-4880-930c-f046a5b64a79]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:15 user nova-compute[70375]: WARNING nova.compute.manager [req-e01d3044-aff6-4e7b-b948-a2836ac3f02a req-e538cf48-200e-4c61-b731-6a8cb5539e7d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state building and task_state spawning.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f7f05-f7eb-4582-b058-4b3805566fbb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]
Jul 24 17:56:15 user nova-compute[70375]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c328c-c221-4ff8-8296-8ae60ea78651]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== disconnect_volume: return (351ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221375.2195616, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Resumed (Lifecycle Event)
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.260s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:15 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:15 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance spawned successfully.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8284841-3a88-4ec9-98b8-72e98479b213]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:56:15 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221375.2198331, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Started (Lifecycle Event)
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db952f56-08ae-4970-bf14-ddfdc4f99678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b] added
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06d7f4-a370-4f6c-b530-34753130c7fb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ff78d-e7f7-4313-8bd4-2699bbd0ae85]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPDxuUhH {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPDxuUhH" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9415d-b073-43b7-94b9-32a4a0fc085e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NPDxuUhH'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f6bd2-6e0f-4723-802b-d0ae87dde335]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810d494-7158-4625-95da-966a17c0ebc4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: INFO nova.compute.manager [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Took 6.61 seconds to build instance.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-45ff998f-db67-4923-990c-5585cadc4235 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.731s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa5452f-d708-4462-8988-1b2242a02210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260]
Jul 24 17:56:15 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:15 user nova-compute[70375]: WARNING nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state active and task_state rebuilding.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:15 user nova-compute[70375]: WARNING nova.compute.manager [req-a3f8066b-a422-4889-9636-a19de8148a3f req-6b6dbbd9-9e07-4256-a7e6-2e104948f7b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state active and task_state rebuilding.
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629f897-172e-45bd-9f6f-c16193477d07]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[48357ca7-42da-453e-984a-4271b03a7e6c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:15 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:15 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:15 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e3334-63eb-4ea1-8bb1-d3ece7f8adf0]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPDxuUhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:56:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance destroyed successfully.
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-624507986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc33dfa8-db, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:16 user nova-compute[70375]: INFO os_vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db')
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:16 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== connect_volume: return (1657ms) {'type': 'block', 'scsi_wwn': '23130666436396263', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130666436396263', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.450s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf7336-96f0-4b37-a764-c6e42d8c9ef3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:56:16 user nova-compute[70375]: No targets found.
Jul 24 17:56:16 user nova-compute[70375]: iSNS:
Jul 24 17:56:16 user nova-compute[70375]: No targets found.
Jul 24 17:56:16 user nova-compute[70375]: STATIC:
Jul 24 17:56:16 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:56:16 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:16 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:16 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b
Jul 24 17:56:16 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:16 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:16 user nova-compute[70375]: FIRMWARE:
Jul 24 17:56:16 user nova-compute[70375]: No targets found.
Jul 24 17:56:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:56:16 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:56:16 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:56:16 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:16 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:56:16 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:16 user nova-compute[70375]:   <serial>5d21e633-d7c7-4186-84b2-ecb43852026b</serial>
Jul 24 17:56:16 user nova-compute[70375]: </disk>
Jul 24 17:56:16 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[99086f7e-88cc-4725-98c7-243ac8052949]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[edffe11a-4d89-4bc9-9490-eaba81f2aaf9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:16 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:16 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650358700>, {}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Disconnecting from: [] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== disconnect_volume: return (531ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:56:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Deleting instance files /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63_del
Jul 24 17:56:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Deletion of /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63_del complete
Jul 24 17:56:16 user nova-compute[70375]: INFO nova.virt.block_device [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Booting with volume 78cff04d-f365-4b90-9b96-37b556e2c234 at /dev/vdb
Jul 24 17:56:16 user nova-compute[70375]: DEBUG os_brick.utils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd300a-4ab9-4e05-b975-4e144ca97074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b5eaf0-a442-45db-9d16-44fd0d3d5aef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7b4fd-ce52-4e52-8172-6c5b5864639e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c43a24-f4c9-4f3d-aa63-df96b82abb19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:17 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a2da0-6c79-467c-93a7-aa016ed8dce2]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.utils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating existing volume attachment record: e19108fb-257f-401b-8c75-587763daf9c2 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No VIF found with MAC fa:16:3e:fa:aa:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f9964954-0f05-40ea-a6de-6d6d69e34c82 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.445s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:17 user nova-compute[70375]: INFO nova.compute.manager [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Attaching volume 144cc41f-35f6-49e6-a416-ac4296910f01 to /dev/vdb
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.utils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a57074e-0e82-46e5-8e7d-c1f4b1df350b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf69ea9-1587-4083-bed0-d754ee3377fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b6a2f8-1d1f-4e00-8b79-fefb303a3d45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18d36b-7f15-4336-9d4f-21824ed18bc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:56:17 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:56:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba698831-00d1-4882-86e6-e2da045d0216]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG os_brick.utils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:17 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updating existing volume attachment record: 1cc04782-8b0a-4d7d-8646-ca098060c82c {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:56:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:24 user nova-compute[70375]: INFO nova.compute.manager [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Terminating instance
Jul 24 17:56:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-52211798-957d-4085-b36a-a83ed72222cd req-20904441-7bee-46d5-95e8-68e1d4c44d2f service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-unplugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:56:24 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Instance destroyed successfully.
Jul 24 17:56:24 user nova-compute[70375]: DEBUG nova.objects.instance [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lazy-loading 'resources' on Instance uuid 81fd89d8-c2b9-4398-83f5-0ddb45f14722 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-358915896',display_name='tempest-ServerActionsTestOtherB-server-358915896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-358915896',id=5,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrNLUQIb7hyRrrYUaOyQb1Fg0KK3ZJOjxfNXamBGRl/HberoRfAjrYmGU/l0d8ztAgqMj4BA5BD2iTriA/dF5fc8M40c59fXSWDh31qzaWRjQpuoYvmK7DHHgq1Gmf0Xg==',key_name='tempest-keypair-1964029712',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a79f1241a80f4fe498df5e46217254d1',ramdisk_id='',reservation_id='r-1x7aqezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1934690611',owner_user_name='tempest-ServerActionsTestOtherB-1934690611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:53:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49c33bc394214fa1a864e79cdef00465',uuid=81fd89d8-c2b9-4398-83f5-0ddb45f14722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converting VIF {"id": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "address": "fa:16:3e:4d:88:af", "network": {"id": "44156948-ad70-4c45-be60-18ed01d90258", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1962594089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a79f1241a80f4fe498df5e46217254d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b0448f-d9", "ovs_interfaceid": "68b0448f-d9ad-4486-9db5-9d9f1f626cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_vif [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b0448f-d9, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:56:25 user nova-compute[70375]: INFO os_vif [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:88:af,bridge_name='br-int',has_traffic_filtering=True,id=68b0448f-d9ad-4486-9db5-9d9f1f626cae,network=Network(44156948-ad70-4c45-be60-18ed01d90258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b0448f-d9')
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FhbMZjpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a54a6-4e78-4909-84cb-736344a9fd81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:56:25 user nova-compute[70375]: No targets found.
Jul 24 17:56:25 user nova-compute[70375]: iSNS:
Jul 24 17:56:25 user nova-compute[70375]: No targets found.
Jul 24 17:56:25 user nova-compute[70375]: STATIC:
Jul 24 17:56:25 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8
Jul 24 17:56:25 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:25 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:25 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b
Jul 24 17:56:25 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:25 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:25 user nova-compute[70375]: FIRMWARE:
Jul 24 17:56:25 user nova-compute[70375]: No targets found.
Jul 24 17:56:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:56:25 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:56:25 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2110dc-cdb7-4f52-89d1-d00e451dc17f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00206f49-0b95-4dee-a816-c820224b27ad]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:25 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 (non-flash)
Jul 24 17:56:25 user nova-compute[70375]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483d1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9450c8-f601-40ba-aa9b-74dbdd73a87e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7c38c-4368-4c78-87c2-716bcdca82dd]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:56:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Creating image(s)
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd950e17-ad11-46e0-bc44-ad15b5048d8e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99933c3-0ed0-41ee-a00d-4891cea1a16d]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abefba-8b4e-436e-a1d3-3d468af8d928]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[334af64e-341d-48ff-8e17-616c9bd5e9f4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260]
Jul 24 17:56:25 user nova-compute[70375]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d1e070-72bc-4042-a555-39471203d2f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c707dc-fc0c-43f8-8113-90a929218567]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] <== disconnect_volume: return (425ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:56:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Deleting instance files /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_del
Jul 24 17:56:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Deletion of /opt/stack/data/nova/instances/81fd89d8-c2b9-4398-83f5-0ddb45f14722_del complete
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk 1073741824" returned: 0 in 0.058s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: INFO nova.compute.manager [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Took 1.53 seconds to destroy the instance on the hypervisor.
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmuEtgSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:25 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[782cfd7a-8d2f-4e7f-9c7c-f6c0d646dc03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:56:25 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Skipping network cache update for instance because it is being deleted. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9871}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[276dd7f3-bf8e-4916-a3e4-8d312533634e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01] added
Jul 24 17:56:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Cannot resize image /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Ensure instance console log exists: /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start _get_guest_xml network_info=[{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e19108fb-257f-401b-8c75-587763daf9c2', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9228b8cf-e00a-4a57-9762-3e9063199d63', 'attached_at': '', 'detached_at': '', 'volume_id': '78cff04d-f365-4b90-9b96-37b556e2c234', 'serial': '78cff04d-f365-4b90-9b96-37b556e2c234'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df117f-8625-4df5-961d-a8664de31f50]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 17:56:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9801528b-bd0e-4624-81bb-29accc719bdd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:56:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmuEtgSO {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:26 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmuEtgSO" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ece66d-3d7d-4c39-a5dd-e875b4d25b05]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmuEtgSO'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec4fb13-9f93-42b1-bf27-31d90e2bdc3c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[219a0d3c-c0b8-489d-a64e-727312025b21]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f375c-1e63-4861-80e4-455402c4c3aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260]
Jul 24 17:56:26 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a74b7c0-4e86-4cc7-8ec1-1f1de4b7308a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0027b-edfc-4834-9af1-1d25329bad30]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:26 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:26 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e674e-a655-49de-ac03-4b873c0346e1]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmuEtgSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] Acquiring lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] No waiting events found dispatching network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:26 user nova-compute[70375]: WARNING nova.compute.manager [req-7d2694e5-30e8-4174-8dca-3dfe5225166a req-faad7c75-eaaa-4b3d-aa6b-b8dc68260886 service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received unexpected event network-vif-plugged-68b0448f-d9ad-4486-9db5-9d9f1f626cae for instance with vm_state active and task_state deleting.
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:27 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Took 1.53 seconds to deallocate network for instance.
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26566366662353337', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566366662353337', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-38fbc19e-ad73-4ff9-89d8-f6a1ca73d043 req-cef2c01b-b22c-4751-9ef1-6223899d700b service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Received event network-vif-deleted-68b0448f-d9ad-4486-9db5-9d9f1f626cae {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:27 user nova-compute[70375]: INFO nova.compute.manager [req-38fbc19e-ad73-4ff9-89d8-f6a1ca73d043 req-cef2c01b-b22c-4751-9ef1-6223899d700b service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Neutron deleted interface 68b0448f-d9ad-4486-9db5-9d9f1f626cae; detaching it from the instance and deleting it from the info cache
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.network.neutron [req-38fbc19e-ad73-4ff9-89d8-f6a1ca73d043 req-cef2c01b-b22c-4751-9ef1-6223899d700b service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.211s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:27 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:27 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-38fbc19e-ad73-4ff9-89d8-f6a1ca73d043 req-cef2c01b-b22c-4751-9ef1-6223899d700b service nova] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Detach interface failed, port_id=68b0448f-d9ad-4486-9db5-9d9f1f626cae, reason: Instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffcf1b-43e8-46b9-8eea-448558f3ddf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:56:27 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[22344396-671c-42b1-925b-50ba45256649]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234] added
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:56:27 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:27 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:56:27 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:27 user nova-compute[70375]:   <serial>144cc41f-35f6-49e6-a416-ac4296910f01</serial>
Jul 24 17:56:27 user nova-compute[70375]: </disk>
Jul 24 17:56:27 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f2558-8cc0-4ab5-af8e-e6c88946cb07]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17117c-55f9-48d5-8304-b14cdb46a6f9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMzQmxI {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMzQmxI" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ae996-8238-43c8-a135-7f339fce6e36]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrMzQmxI'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c68be1-3664-4cf3-b7f4-82ce39d29095]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b1f4d-4b83-4076-be8c-e201ceec033c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc81b9e-fc68-4642-b9a8-7914bdde500e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]
Jul 24 17:56:27 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece37463-0958-419a-a00f-c4241b866818]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fd3bff-79a0-452c-8132-a4a965546f55]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:27 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[36290572-2f86-4dce-bd5e-af44e0d79ef7]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:11:d9:6b, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7e53ac1-c0ca-4b49-a423-edebcbfa9ac9 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.465s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:28 user nova-compute[70375]: INFO nova.compute.manager [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Took 1.14 seconds to detach 1 volumes for instance.
Jul 24 17:56:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== connect_volume: return (2566ms) {'type': 'block', 'scsi_wwn': '26662356331616666', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662356331616666', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-624507986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:56:28 user nova-compute[70375]:   <uuid>9228b8cf-e00a-4a57-9762-3e9063199d63</uuid>
Jul 24 17:56:28 user nova-compute[70375]:   <name>instance-00000010</name>
Jul 24 17:56:28 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:56:28 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:56:28 user nova-compute[70375]:   <metadata>
Jul 24 17:56:28 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:56:28 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherA-server-624507986</nova:name>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:56:25</nova:creationTime>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:56:28 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:56:28 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:owner>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:user uuid="aa75ae32ac1049f794ce2f8433df6529">tempest-ServerActionsTestOtherA-528723047-project-member</nova:user>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:project uuid="d07a82b57ae84e8892d950cdc0d7507b">tempest-ServerActionsTestOtherA-528723047</nova:project>
Jul 24 17:56:28 user nova-compute[70375]:       </nova:owner>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:56:28 user nova-compute[70375]:       <nova:ports>
Jul 24 17:56:28 user nova-compute[70375]:         <nova:port uuid="cc33dfa8-db53-43b9-846b-e8f09e846c71">
Jul 24 17:56:28 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:56:28 user nova-compute[70375]:         </nova:port>
Jul 24 17:56:28 user nova-compute[70375]:       </nova:ports>
Jul 24 17:56:28 user nova-compute[70375]:     </nova:instance>
Jul 24 17:56:28 user nova-compute[70375]:   </metadata>
Jul 24 17:56:28 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:56:28 user nova-compute[70375]:     <system>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="serial">9228b8cf-e00a-4a57-9762-3e9063199d63</entry>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="uuid">9228b8cf-e00a-4a57-9762-3e9063199d63</entry>
Jul 24 17:56:28 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:56:28 user nova-compute[70375]:     </system>
Jul 24 17:56:28 user nova-compute[70375]:   </sysinfo>
Jul 24 17:56:28 user nova-compute[70375]:   <os>
Jul 24 17:56:28 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:56:28 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:56:28 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:56:28 user nova-compute[70375]:   </os>
Jul 24 17:56:28 user nova-compute[70375]:   <features>
Jul 24 17:56:28 user nova-compute[70375]:     <acpi/>
Jul 24 17:56:28 user nova-compute[70375]:     <apic/>
Jul 24 17:56:28 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:56:28 user nova-compute[70375]:   </features>
Jul 24 17:56:28 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:56:28 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:56:28 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:56:28 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:56:28 user nova-compute[70375]:   </clock>
Jul 24 17:56:28 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:56:28 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:56:28 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:56:28 user nova-compute[70375]:   </cpu>
Jul 24 17:56:28 user nova-compute[70375]:   <devices>
Jul 24 17:56:28 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:56:28 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:56:28 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk"/>
Jul 24 17:56:28 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:56:28 user nova-compute[70375]:     </disk>
Jul 24 17:56:28 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:56:28 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:28 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 17:56:28 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:56:28 user nova-compute[70375]:       <serial>78cff04d-f365-4b90-9b96-37b556e2c234</serial>
Jul 24 17:56:28 user nova-compute[70375]:     </disk>
Jul 24 17:56:28 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:56:28 user nova-compute[70375]:       <mac address="fa:16:3e:19:ad:ce"/>
Jul 24 17:56:28 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:56:28 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:56:28 user nova-compute[70375]:       <target dev="tapcc33dfa8-db"/>
Jul 24 17:56:28 user nova-compute[70375]:     </interface>
Jul 24 17:56:28 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:56:28 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/console.log" append="off"/>
Jul 24 17:56:28 user nova-compute[70375]:     </serial>
Jul 24 17:56:28 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:56:28 user nova-compute[70375]:     <video>
Jul 24 17:56:28 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:56:28 user nova-compute[70375]:     </video>
Jul 24 17:56:28 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:56:28 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:56:28 user nova-compute[70375]:     </rng>
Jul 24 17:56:28 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:56:28 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:56:28 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:56:28 user nova-compute[70375]:     </memballoon>
Jul 24 17:56:28 user nova-compute[70375]:   </devices>
Jul 24 17:56:28 user nova-compute[70375]: </domain>
Jul 24 17:56:28 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-624507986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG os_vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc33dfa8-db, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc33dfa8-db, col_values=(('external_ids', {'iface-id': 'cc33dfa8-db53-43b9-846b-e8f09e846c71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:ad:ce', 'vm-uuid': '9228b8cf-e00a-4a57-9762-3e9063199d63'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:28 user nova-compute[70375]: INFO os_vif [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db')
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No VIF found with MAC fa:16:3e:19:ad:ce, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:56:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:28 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Deleted allocations for instance 81fd89d8-c2b9-4398-83f5-0ddb45f14722
Jul 24 17:56:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6af466e3-507e-48d9-acaf-c7cbbcbf49cb tempest-ServerActionsTestOtherB-1934690611 tempest-ServerActionsTestOtherB-1934690611-project-member] Lock "81fd89d8-c2b9-4398-83f5-0ddb45f14722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.964s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:29 user nova-compute[70375]: INFO nova.compute.manager [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Detaching volume 144cc41f-35f6-49e6-a416-ac4296910f01
Jul 24 17:56:29 user nova-compute[70375]: INFO nova.virt.block_device [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Attempting to driver detach volume 144cc41f-35f6-49e6-a416-ac4296910f01 from mountpoint /dev/vdb
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Attempting to detach device vdb from instance f377f3ff-db0f-40f5-b183-e493a90c0e9b from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:56:29 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:29 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:56:29 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:29 user nova-compute[70375]:   <serial>144cc41f-35f6-49e6-a416-ac4296910f01</serial>
Jul 24 17:56:29 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:56:29 user nova-compute[70375]: </disk>
Jul 24 17:56:29 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:56:29 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance f377f3ff-db0f-40f5-b183-e493a90c0e9b from the persistent domain config.
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f377f3ff-db0f-40f5-b183-e493a90c0e9b from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:56:29 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:29 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:56:29 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:29 user nova-compute[70375]:   <serial>144cc41f-35f6-49e6-a416-ac4296910f01</serial>
Jul 24 17:56:29 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:56:29 user nova-compute[70375]: </disk>
Jul 24 17:56:29 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221374.6170895, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:29 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Stopped (Lifecycle Event)
Jul 24 17:56:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b47a145c-3901-4d88-8c1f-b5760cdbab6f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221390.0775304, f377f3ff-db0f-40f5-b183-e493a90c0e9b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:56:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance f377f3ff-db0f-40f5-b183-e493a90c0e9b from the live domain config.
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmuEtgSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:30 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cac9ab-f0b7-40d4-9acf-7cbe2ad67f3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:56:30 user nova-compute[70375]: No targets found.
Jul 24 17:56:30 user nova-compute[70375]: iSNS:
Jul 24 17:56:30 user nova-compute[70375]: No targets found.
Jul 24 17:56:30 user nova-compute[70375]: STATIC:
Jul 24 17:56:30 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01
Jul 24 17:56:30 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:30 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:30 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:56:30 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:30 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:30 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b
Jul 24 17:56:30 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:30 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:30 user nova-compute[70375]: FIRMWARE:
Jul 24 17:56:30 user nova-compute[70375]: No targets found.
Jul 24 17:56:30 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:56:30 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:56:30 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1af02-1321-49a6-8236-51f69cf1ba78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7c0256-ea59-4216-9a9c-506fb3fb2655]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:30 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:30 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:30 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:30 user nova-compute[70375]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 (non-flash)
Jul 24 17:56:30 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:30 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650358d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddee870-0131-4c8f-8612-f427b52fb289]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bad24c-635d-4825-8aaf-111347d6aa97]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb17eb-bfc9-44f0-961a-e47acf233a99]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.158s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aac11b-e55e-4d9d-abe4-854156c848ef]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6c6b9b-3230-4fa7-8424-b6af0fcbc4c4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df16938-f8f8-4c1e-9a7e-e57f5640b1a6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260]
Jul 24 17:56:30 user nova-compute[70375]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:30 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:144cc41f-35f6-49e6-a416-ac4296910f01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2e14ef-9c50-442f-b8b9-258139baa699]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== disconnect_volume: return (471ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:30 user nova-compute[70375]: WARNING nova.compute.manager [req-7a6ec3a1-5c4c-4036-ae68-70dee403ad6a req-c7fad058-d2ba-43ff-96c1-8a991feda1b5 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 17:56:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:31 user nova-compute[70375]: DEBUG nova.objects.instance [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-bfe9333e-c255-40c7-888d-56149d4d4662 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.943s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:56:32 user nova-compute[70375]: WARNING nova.compute.manager [req-1025a70c-2e66-4e31-9ca6-ca62962a9351 req-a2318a06-b986-4e9d-9ec2-83737354f9f8 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221392.917107, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:32 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Resumed (Lifecycle Event)
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:56:32 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance spawned successfully.
Jul 24 17:56:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:56:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221392.9189508, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Started (Lifecycle Event)
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:56:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70375) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-52dd295a-e4b5-43ac-91fc-9fbb2725e159 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.137s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:34 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:56:34 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=24.491546630859375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f377f3ff-db0f-40f5-b183-e493a90c0e9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:56:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:56:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:56:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:56:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:56:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:39 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221384.9741771, 81fd89d8-c2b9-4398-83f5-0ddb45f14722 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:56:39 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] VM Stopped (Lifecycle Event)
Jul 24 17:56:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f0ae5f26-966e-479e-81a2-952f9ca66710 None None] [instance: 81fd89d8-c2b9-4398-83f5-0ddb45f14722] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:56:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:56:42 user nova-compute[70375]: INFO nova.compute.manager [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Detaching volume 5d21e633-d7c7-4186-84b2-ecb43852026b
Jul 24 17:56:42 user nova-compute[70375]: INFO nova.virt.block_device [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attempting to driver detach volume 5d21e633-d7c7-4186-84b2-ecb43852026b from mountpoint /dev/vdb
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Attempting to detach device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:56:42 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:42 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:56:42 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:42 user nova-compute[70375]:   <serial>5d21e633-d7c7-4186-84b2-ecb43852026b</serial>
Jul 24 17:56:42 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:56:42 user nova-compute[70375]: </disk>
Jul 24 17:56:42 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:56:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config.
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:56:42 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:56:42 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 17:56:42 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:56:42 user nova-compute[70375]:   <serial>5d21e633-d7c7-4186-84b2-ecb43852026b</serial>
Jul 24 17:56:42 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:56:42 user nova-compute[70375]: </disk>
Jul 24 17:56:42 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221402.8304486, c97c022f-1bca-4f38-b876-604724ed6442 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:56:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config.
Jul 24 17:56:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPDxuUhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:56:42 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b48197-e33f-4b27-9864-5dd829ea87d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:56:42 user nova-compute[70375]: No targets found.
Jul 24 17:56:42 user nova-compute[70375]: iSNS:
Jul 24 17:56:42 user nova-compute[70375]: No targets found.
Jul 24 17:56:42 user nova-compute[70375]: STATIC:
Jul 24 17:56:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:56:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:42 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b
Jul 24 17:56:42 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:56:42 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:56:42 user nova-compute[70375]: FIRMWARE:
Jul 24 17:56:42 user nova-compute[70375]: No targets found.
Jul 24 17:56:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:56:42 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:56:42 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480bd07-1e17-480c-b453-377d0aca87d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df96b6f-948b-4b8a-93cf-2b1c1549d076]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:42 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b (non-flash)
Jul 24 17:56:42 user nova-compute[70375]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:56:42 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe648388f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b5da49-0999-4661-a260-ae74334cb5fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[388596ee-4ba5-4ca1-b6b1-565394bb6fa5]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:56:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e7a48-1e2f-4b77-8044-2f94d6036767]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[61922839-e27c-420c-9029-609260a04891]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d668d187-9c2f-467d-928c-dc4de5a3e79e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d3bc94-f125-4bb6-8830-bb7d35e4d933]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260]
Jul 24 17:56:43 user nova-compute[70375]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b, portal: 172.16.0.220,3260] successful.
Jul 24 17:56:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d21e633-d7c7-4186-84b2-ecb43852026b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ca3dc-0cf4-4909-877c-4c7eca4a3a8a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== disconnect_volume: return (349ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:56:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90add9bf-06cd-496d-9216-b0c4205734f3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.877s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:56:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:56:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:57:01 user nova-compute[70375]: INFO nova.compute.claims [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Claim successful on node user
Jul 24 17:57:01 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:57:01 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:57:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.policy [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1395e4ee5bd4408783d423729093834d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa85032ee2074843ab0c0a4d27947eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:57:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Creating image(s)
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "/opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "/opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "/opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk 1073741824" returned: 0 in 0.046s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Cannot resize image /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'migration_context' on Instance uuid 44bdf20e-8189-4fdf-8c00-3ff733fb357b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Ensure instance console log exists: /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Successfully created port: a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Successfully updated port: a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquired lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-changed-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Refreshing instance network info cache due to event network-changed-a05d138d-5697-4845-abef-b690c3032e5d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] Acquiring lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:57:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updating instance_info_cache with network_info: [{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Releasing lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Instance network_info: |[{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] Acquired lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Refreshing network info cache for port a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Start _get_guest_xml network_info=[{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:57:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:57:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-893177979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-893177979',id=23,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXiLv8uYiHK9Yr5uEtjaxpudibS8d5e22Pgb/S6+u+15r+0R/0GeTiIrwYV3cwSGgDU3LhktZoA5cbl4t3IaL8vSjAusynkuEC1o7sZwMBx6F+WDGJal4bH8CBSeKCA+w==',key_name='tempest-keypair-694518500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-o9ulwd00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=44bdf20e-8189-4fdf-8c00-3ff733fb357b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'pci_devices' on Instance uuid 44bdf20e-8189-4fdf-8c00-3ff733fb357b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:57:04 user nova-compute[70375]:   <uuid>44bdf20e-8189-4fdf-8c00-3ff733fb357b</uuid>
Jul 24 17:57:04 user nova-compute[70375]:   <name>instance-00000017</name>
Jul 24 17:57:04 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:57:04 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:57:04 user nova-compute[70375]:   <metadata>
Jul 24 17:57:04 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:57:04 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:name>tempest-ServerActionsV293TestJSON-server-893177979</nova:name>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:57:04</nova:creationTime>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:57:04 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:57:04 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:owner>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:user uuid="1395e4ee5bd4408783d423729093834d">tempest-ServerActionsV293TestJSON-1282122326-project-member</nova:user>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:project uuid="aa85032ee2074843ab0c0a4d27947eda">tempest-ServerActionsV293TestJSON-1282122326</nova:project>
Jul 24 17:57:04 user nova-compute[70375]:       </nova:owner>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:57:04 user nova-compute[70375]:       <nova:ports>
Jul 24 17:57:04 user nova-compute[70375]:         <nova:port uuid="a05d138d-5697-4845-abef-b690c3032e5d">
Jul 24 17:57:04 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:57:04 user nova-compute[70375]:         </nova:port>
Jul 24 17:57:04 user nova-compute[70375]:       </nova:ports>
Jul 24 17:57:04 user nova-compute[70375]:     </nova:instance>
Jul 24 17:57:04 user nova-compute[70375]:   </metadata>
Jul 24 17:57:04 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:57:04 user nova-compute[70375]:     <system>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="serial">44bdf20e-8189-4fdf-8c00-3ff733fb357b</entry>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="uuid">44bdf20e-8189-4fdf-8c00-3ff733fb357b</entry>
Jul 24 17:57:04 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:57:04 user nova-compute[70375]:     </system>
Jul 24 17:57:04 user nova-compute[70375]:   </sysinfo>
Jul 24 17:57:04 user nova-compute[70375]:   <os>
Jul 24 17:57:04 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:57:04 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:57:04 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:57:04 user nova-compute[70375]:   </os>
Jul 24 17:57:04 user nova-compute[70375]:   <features>
Jul 24 17:57:04 user nova-compute[70375]:     <acpi/>
Jul 24 17:57:04 user nova-compute[70375]:     <apic/>
Jul 24 17:57:04 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:57:04 user nova-compute[70375]:   </features>
Jul 24 17:57:04 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:57:04 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:57:04 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:57:04 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:57:04 user nova-compute[70375]:   </clock>
Jul 24 17:57:04 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:57:04 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:57:04 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:57:04 user nova-compute[70375]:   </cpu>
Jul 24 17:57:04 user nova-compute[70375]:   <devices>
Jul 24 17:57:04 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:57:04 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:57:04 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk"/>
Jul 24 17:57:04 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:57:04 user nova-compute[70375]:     </disk>
Jul 24 17:57:04 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:57:04 user nova-compute[70375]:       <mac address="fa:16:3e:ba:65:c3"/>
Jul 24 17:57:04 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:57:04 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:57:04 user nova-compute[70375]:       <target dev="tapa05d138d-56"/>
Jul 24 17:57:04 user nova-compute[70375]:     </interface>
Jul 24 17:57:04 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:57:04 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/console.log" append="off"/>
Jul 24 17:57:04 user nova-compute[70375]:     </serial>
Jul 24 17:57:04 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:57:04 user nova-compute[70375]:     <video>
Jul 24 17:57:04 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:57:04 user nova-compute[70375]:     </video>
Jul 24 17:57:04 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:57:04 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:57:04 user nova-compute[70375]:     </rng>
Jul 24 17:57:04 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:57:04 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:57:04 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:57:04 user nova-compute[70375]:     </memballoon>
Jul 24 17:57:04 user nova-compute[70375]:   </devices>
Jul 24 17:57:04 user nova-compute[70375]: </domain>
Jul 24 17:57:04 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-893177979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-893177979',id=23,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXiLv8uYiHK9Yr5uEtjaxpudibS8d5e22Pgb/S6+u+15r+0R/0GeTiIrwYV3cwSGgDU3LhktZoA5cbl4t3IaL8vSjAusynkuEC1o7sZwMBx6F+WDGJal4bH8CBSeKCA+w==',key_name='tempest-keypair-694518500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-o9ulwd00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=44bdf20e-8189-4fdf-8c00-3ff733fb357b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG os_vif [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa05d138d-56, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa05d138d-56, col_values=(('external_ids', {'iface-id': 'a05d138d-5697-4845-abef-b690c3032e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:65:c3', 'vm-uuid': '44bdf20e-8189-4fdf-8c00-3ff733fb357b'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:04 user nova-compute[70375]: INFO os_vif [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56')
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No VIF found with MAC fa:16:3e:ba:65:c3, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updated VIF entry in instance network info cache for port a05d138d-5697-4845-abef-b690c3032e5d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updating instance_info_cache with network_info: [{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:57:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-de17292e-335e-47ef-9eea-8c294cea9ed9 req-a4141784-0b10-47fb-bd59-38ac307245d8 service nova] Releasing lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] No waiting events found dispatching network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:05 user nova-compute[70375]: WARNING nova.compute.manager [req-6577619b-d1af-44e5-96e8-55532f1feea7 req-51cbf99b-b334-48b6-a335-2628449b48d3 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received unexpected event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d for instance with vm_state building and task_state spawning.
Jul 24 17:57:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221427.769863, 44bdf20e-8189-4fdf-8c00-3ff733fb357b => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] VM Resumed (Lifecycle Event)
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Instance spawned successfully.
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221427.774017, 44bdf20e-8189-4fdf-8c00-3ff733fb357b => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] VM Started (Lifecycle Event)
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Took 5.71 seconds to spawn the instance on the hypervisor.
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] No waiting events found dispatching network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:07 user nova-compute[70375]: WARNING nova.compute.manager [req-6f1cd8ee-4c67-427a-b56b-bcb616dd7ce3 req-1190a52f-6cf3-4e18-a860-6c4d0ac777bd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received unexpected event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d for instance with vm_state building and task_state spawning.
Jul 24 17:57:07 user nova-compute[70375]: INFO nova.compute.manager [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] instance snapshotting
Jul 24 17:57:08 user nova-compute[70375]: INFO nova.compute.manager [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Took 6.40 seconds to build instance.
Jul 24 17:57:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Beginning live snapshot process
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c77aef9-7efe-4aa5-9032-b31903ccf7d8 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.532s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6.delta 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6.delta 1073741824" returned: 0 in 0.048s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 17:57:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:57:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 17:57:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 17:57:10 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 17:57:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6.delta /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6.delta /opt/stack/data/nova/instances/snapshots/tmpqhg8h33c/93ef0ad82304417da687e994ff841fb6" returned: 0 in 0.636s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Snapshot extracted, beginning image upload
Jul 24 17:57:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:13 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Snapshot image upload complete
Jul 24 17:57:13 user nova-compute[70375]: INFO nova.compute.manager [None req-96c193f8-bf11-4934-b7a5-e156a738fd3e tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Took 5.56 seconds to snapshot the instance on the hypervisor.
Jul 24 17:57:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:19 user nova-compute[70375]: INFO nova.compute.manager [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Terminating instance
Jul 24 17:57:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-f0a6fbcb-f553-4f95-b387-0572a5681a9f req-8a29a4af-3151-4523-b3f0-f009f603f950 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Instance destroyed successfully.
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'resources' on Instance uuid f377f3ff-db0f-40f5-b183-e493a90c0e9b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30987841',display_name='tempest-AttachVolumeNegativeTest-server-30987841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30987841',id=20,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNfM9jg2OwCGRChWJeGd08leM7FNzlBZSJxfJkZQZOMBlA6Ud3+aibqH1kEtFOL7dF590w601F4VP2XZf362XajsJhsDP5lWJCJNpdvnF7fVassu3biiu4oq7F++KSx/A==',key_name='tempest-keypair-740555913',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-u14194fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=f377f3ff-db0f-40f5-b183-e493a90c0e9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "57a5dc5d-5db6-437b-8579-def74159e777", "address": "fa:16:3e:11:d9:6b", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a5dc5d-5d", "ovs_interfaceid": "57a5dc5d-5db6-437b-8579-def74159e777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG os_vif [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57a5dc5d-5d, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:57:20 user nova-compute[70375]: INFO os_vif [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:d9:6b,bridge_name='br-int',has_traffic_filtering=True,id=57a5dc5d-5db6-437b-8579-def74159e777,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a5dc5d-5d')
Jul 24 17:57:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Deleting instance files /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b_del
Jul 24 17:57:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Deletion of /opt/stack/data/nova/instances/f377f3ff-db0f-40f5-b183-e493a90c0e9b_del complete
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: INFO nova.compute.manager [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 17:57:20 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:21 user nova-compute[70375]: WARNING nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state active and task_state deleting.
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:21 user nova-compute[70375]: WARNING nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state active and task_state deleting.
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:21 user nova-compute[70375]: WARNING nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state active and task_state deleting.
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-8c1d470f-1496-43ca-8ee2-cd1f39cc3c19 req-1dc2852c-4934-4913-ba5e-d0ad08797030 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-unplugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:57:22 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:57:22 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Took 2.38 seconds to deallocate network for instance.
Jul 24 17:57:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:23 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:57:23 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:57:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:23 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Deleted allocations for instance f377f3ff-db0f-40f5-b183-e493a90c0e9b
Jul 24 17:57:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6ea053ac-062e-46dc-8672-f2c7209f75b3 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.976s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-deleted-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] Acquiring lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] Lock "f377f3ff-db0f-40f5-b183-e493a90c0e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] No waiting events found dispatching network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:57:24 user nova-compute[70375]: WARNING nova.compute.manager [req-ead6d30a-c1c4-41de-8f30-a79dda9596eb req-83b31c68-a2bc-42ac-8d5c-9167b7aac293 service nova] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Received unexpected event network-vif-plugged-57a5dc5d-5db6-437b-8579-def74159e777 for instance with vm_state deleted and task_state None.
Jul 24 17:57:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:57:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221440.1816978, f377f3ff-db0f-40f5-b183-e493a90c0e9b => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:57:35 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] VM Stopped (Lifecycle Event)
Jul 24 17:57:35 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:57:35 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=24.406219482421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ebaba4b8-926c-4e52-9a94-99819aebecca None None] [instance: f377f3ff-db0f-40f5-b183-e493a90c0e9b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG nova.objects.instance [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:37 user nova-compute[70375]: INFO nova.compute.manager [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attaching volume 113593a5-07d1-41c5-95f2-cea49bbf979d to /dev/vdb
Jul 24 17:57:37 user nova-compute[70375]: DEBUG os_brick.utils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[814063e3-06a4-4c55-bad2-28eaadc76643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4821f8-12cc-41c5-82fb-5a7891747dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6095ca12-393e-4d3c-b7c3-c8df6fe9935f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a7b71-6a39-4b13-8fcf-053d083f5287]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:57:37 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:57:37 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c93c11-18d3-4403-8ec3-b25ae4df93ac]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:57:37 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:57:38 user nova-compute[70375]: DEBUG os_brick.utils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:57:38 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating existing volume attachment record: 5d197d7d-0e10-4f29-b17a-dec332d3ef96 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:57:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itGPlAWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:57:47 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:57:47 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:57:47 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b5f58-ddd1-4b6f-8514-b70c1bde4a7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:57:47 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076e364-dbc7-4ee4-aaea-9dd37e029596]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d] added
Jul 24 17:57:47 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772b8b2-9cda-4263-acb0-f5e0e11d8509]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e401a7-dc51-4156-80d5-d6e80176e13f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itGPlAWc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itGPlAWc" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d018f-e6d7-4f1e-b0a1-7cb8d06c6ed3]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'itGPlAWc'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b2c3b-3f30-4efd-9f6f-5dcfa391055d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ed89f-de73-4380-ab3e-4522652e3179]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4816e05a-4dd8-4ee9-9950-c3bbb33e6b2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260]
Jul 24 17:57:48 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260] successful.
Jul 24 17:57:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5dbaa-6230-413d-a7d8-e8cf9fd39815]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a6ccb7-df7a-45b7-a2e2-f331aa388c6e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:48 user nova-compute[70375]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)
Jul 24 17:57:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:48 user nova-compute[70375]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)
Jul 24 17:57:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d797e7a9-2c73-453e-9a0e-86f3ed9de130]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:48 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itGPlAWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26338633838336666', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338633838336666', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:57:49 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:57:49 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:57:49 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:57:49 user nova-compute[70375]:   <serial>113593a5-07d1-41c5-95f2-cea49bbf979d</serial>
Jul 24 17:57:49 user nova-compute[70375]: </disk>
Jul 24 17:57:49 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No VIF found with MAC fa:16:3e:fa:aa:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:57:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-03341aaa-e9b8-49ec-84c9-1a091d75bfc3 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.939s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:57:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:57:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:57:52 user nova-compute[70375]: INFO nova.compute.manager [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Detaching volume 113593a5-07d1-41c5-95f2-cea49bbf979d
Jul 24 17:57:52 user nova-compute[70375]: INFO nova.virt.block_device [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attempting to driver detach volume 113593a5-07d1-41c5-95f2-cea49bbf979d from mountpoint /dev/vdb
Jul 24 17:57:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Attempting to detach device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:57:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:57:52 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:57:52 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:57:52 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:57:52 user nova-compute[70375]:   <serial>113593a5-07d1-41c5-95f2-cea49bbf979d</serial>
Jul 24 17:57:52 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:57:52 user nova-compute[70375]: </disk>
Jul 24 17:57:52 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:57:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config.
Jul 24 17:57:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:57:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:57:52 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:57:52 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:57:52 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:57:52 user nova-compute[70375]:   <serial>113593a5-07d1-41c5-95f2-cea49bbf979d</serial>
Jul 24 17:57:52 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:57:52 user nova-compute[70375]: </disk>
Jul 24 17:57:52 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221473.0285738, c97c022f-1bca-4f38-b876-604724ed6442 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:57:53 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config.
Jul 24 17:57:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itGPlAWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:57:53 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3333b44-ffdb-447c-a2ce-985c264791a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:57:53 user nova-compute[70375]: No targets found.
Jul 24 17:57:53 user nova-compute[70375]: iSNS:
Jul 24 17:57:53 user nova-compute[70375]: No targets found.
Jul 24 17:57:53 user nova-compute[70375]: STATIC:
Jul 24 17:57:53 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d
Jul 24 17:57:53 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:57:53 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:57:53 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:57:53 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:57:53 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:57:53 user nova-compute[70375]: FIRMWARE:
Jul 24 17:57:53 user nova-compute[70375]: No targets found.
Jul 24 17:57:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:57:53 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:57:53 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e6f1f-763d-4439-b587-ce5f2b5afa5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb44c25-472a-494b-82ac-0a0cfdc29f31]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:53 user nova-compute[70375]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)
Jul 24 17:57:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:57:53 user nova-compute[70375]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d (non-flash)
Jul 24 17:57:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6501913f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ddde4f-6f65-45cd-9ed4-7e179ae4b8ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d15084-dab7-4432-a550-a929c3e1a9d0]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c53613-1dd2-4250-a71d-5190c2c8e82b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca0797-3f63-4a6c-ab91-455e1d8ab243]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b500b5-0cf5-4012-9b76-f488daa8f23e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e62e2f-834c-4a5e-b7df-ca3424dd7e75]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260]
Jul 24 17:57:53 user nova-compute[70375]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d, portal: 172.16.0.220,3260] successful.
Jul 24 17:57:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113593a5-07d1-41c5-95f2-cea49bbf979d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae1e6db-876b-4e46-9c71-90f1b9ae1500]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== disconnect_volume: return (283ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:57:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:57:54 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:57:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c48b982f-b42d-4563-8851-810f48371ff9 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:57:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:57:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing instance network info cache due to event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'flavor' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:00 user nova-compute[70375]: INFO nova.compute.manager [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Attaching volume e551c655-fc53-422f-9934-af24a409a415 to /dev/vdb
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.utils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3763746d-598e-47d8-881e-3eecc6ac25e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67367a60-3b79-4faf-b718-4f10af98ba95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7906a2f-1bb1-4559-976a-5e49a438e255]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380d91e-f773-4558-9cdd-c308efcc2790]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updated VIF entry in instance network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:00 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f6d975-1732-4f85-a051-fe521e69fd9e]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG os_brick.utils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating existing volume attachment record: ee415c2a-fa44-410b-aea2-b47c6bab2df5 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-832a3304-8226-4869-82e2-087df57b7280 req-33ca8056-19dd-49c8-80b9-1cc8596bd0b4 service nova] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXRvGgUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:07 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:07 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:07 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b568bd83-d6b0-4bac-a7c1-c5a2af545320]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:58:07 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[11382530-a2ce-46e5-b0ef-a73dda74fb8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415] added
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a23d26-6963-4eb9-86c8-cc11dd2b393b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd2b34-d4d2-4fa6-b1cd-2b748ab57bbd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXRvGgUs {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXRvGgUs" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[653637ae-345c-4422-94b5-a07ffe4d9c89]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXRvGgUs'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cf3de-7900-4791-b60c-76a6cfb871f7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[619df3f0-2239-4cc7-9ca6-ffb74239a103]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[983ed3a2-e607-4eb7-8842-acfd82785ee1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260]
Jul 24 17:58:07 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260] successful.
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e126b-d56d-4c0e-96f6-0dae93a8ad85]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b33069-ad11-450b-8beb-33013b3dd5d0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12f49bc-f13a-485c-81a6-b127b0840389]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXRvGgUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26233306266333239', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233306266333239', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'flavor' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:58:08 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:58:08 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 17:58:08 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:58:08 user nova-compute[70375]:   <serial>e551c655-fc53-422f-9934-af24a409a415</serial>
Jul 24 17:58:08 user nova-compute[70375]: </disk>
Jul 24 17:58:08 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:58:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:07:ee:a1, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9c35bded-2f59-4f93-92f7-124a636bab9c tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.481s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:10 user nova-compute[70375]: INFO nova.compute.manager [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Rescuing
Jul 24 17:58:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:58:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:12 user nova-compute[70375]: WARNING nova.compute.manager [req-86756d91-43f2-4cb2-9d6b-358461d656b9 req-25598267-91c5-4dbe-abb1-dbc748bf1d11 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state rescuing.
Jul 24 17:58:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance destroyed successfully.
Jul 24 17:58:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Attempting rescue
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 17:58:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Creating image(s)
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'trusted_certs' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue" returned: 0 in 0.059s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'migration_context' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start _get_guest_xml network_info=[{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:07:ee:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'numa_topology' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:12 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-455018711',display_name='tempest-ServerRescueNegativeTestJSON-server-455018711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-455018711',id=22,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+8SRWG8T879MTkJiAHYD9M7E41i9CLX+vusUYAP34t9JA4nlLHTCzh7iAF8gyma58NeSrVAG4czVm/LUYJuauLp7OYHrWzE77OIf/Q7JjWeXUYMLskrjBdCVxJ5Yq53g==',key_name='tempest-keypair-1631665804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-yjbhp7to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=cc5ce8b4-e6f3-4af1-a829-7883fac5847f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:07:ee:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "vif_mac": "fa:16:3e:07:ee:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'pci_devices' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:58:12 user nova-compute[70375]:   <uuid>cc5ce8b4-e6f3-4af1-a829-7883fac5847f</uuid>
Jul 24 17:58:12 user nova-compute[70375]:   <name>instance-00000016</name>
Jul 24 17:58:12 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:58:12 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:58:12 user nova-compute[70375]:   <metadata>
Jul 24 17:58:12 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:58:12 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-455018711</nova:name>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:58:12</nova:creationTime>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:58:12 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:58:12 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:owner>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:user uuid="51a4f4aec1664e07b1d57a7848c02498">tempest-ServerRescueNegativeTestJSON-858879732-project-member</nova:user>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:project uuid="2983b563c19040dfbec3b2c10ce2d14e">tempest-ServerRescueNegativeTestJSON-858879732</nova:project>
Jul 24 17:58:12 user nova-compute[70375]:       </nova:owner>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:58:12 user nova-compute[70375]:       <nova:ports>
Jul 24 17:58:12 user nova-compute[70375]:         <nova:port uuid="08be5745-5810-4b4d-b53c-5efb8aee4493">
Jul 24 17:58:12 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 17:58:12 user nova-compute[70375]:         </nova:port>
Jul 24 17:58:12 user nova-compute[70375]:       </nova:ports>
Jul 24 17:58:12 user nova-compute[70375]:     </nova:instance>
Jul 24 17:58:12 user nova-compute[70375]:   </metadata>
Jul 24 17:58:12 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:58:12 user nova-compute[70375]:     <system>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="serial">cc5ce8b4-e6f3-4af1-a829-7883fac5847f</entry>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="uuid">cc5ce8b4-e6f3-4af1-a829-7883fac5847f</entry>
Jul 24 17:58:12 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:58:12 user nova-compute[70375]:     </system>
Jul 24 17:58:12 user nova-compute[70375]:   </sysinfo>
Jul 24 17:58:12 user nova-compute[70375]:   <os>
Jul 24 17:58:12 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:58:12 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:58:12 user nova-compute[70375]:   </os>
Jul 24 17:58:12 user nova-compute[70375]:   <features>
Jul 24 17:58:12 user nova-compute[70375]:     <acpi/>
Jul 24 17:58:12 user nova-compute[70375]:     <apic/>
Jul 24 17:58:12 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:58:12 user nova-compute[70375]:   </features>
Jul 24 17:58:12 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:58:12 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:58:12 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:58:12 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:58:12 user nova-compute[70375]:   </clock>
Jul 24 17:58:12 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:58:12 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:58:12 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:58:12 user nova-compute[70375]:   </cpu>
Jul 24 17:58:12 user nova-compute[70375]:   <devices>
Jul 24 17:58:12 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:58:12 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:58:12 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue"/>
Jul 24 17:58:12 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:58:12 user nova-compute[70375]:     </disk>
Jul 24 17:58:12 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:58:12 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:58:12 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk"/>
Jul 24 17:58:12 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 17:58:12 user nova-compute[70375]:     </disk>
Jul 24 17:58:12 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:58:12 user nova-compute[70375]:       <mac address="fa:16:3e:07:ee:a1"/>
Jul 24 17:58:12 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:12 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:58:12 user nova-compute[70375]:       <target dev="tap08be5745-58"/>
Jul 24 17:58:12 user nova-compute[70375]:     </interface>
Jul 24 17:58:12 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:58:12 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/console.log" append="off"/>
Jul 24 17:58:12 user nova-compute[70375]:     </serial>
Jul 24 17:58:12 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:58:12 user nova-compute[70375]:     <video>
Jul 24 17:58:12 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:12 user nova-compute[70375]:     </video>
Jul 24 17:58:12 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:58:12 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:58:12 user nova-compute[70375]:     </rng>
Jul 24 17:58:12 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:58:12 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:58:12 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:58:12 user nova-compute[70375]:     </memballoon>
Jul 24 17:58:12 user nova-compute[70375]:   </devices>
Jul 24 17:58:12 user nova-compute[70375]: </domain>
Jul 24 17:58:12 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:58:13 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance destroyed successfully.
Jul 24 17:58:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] No VIF found with MAC fa:16:3e:07:ee:a1, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:14 user nova-compute[70375]: WARNING nova.compute.manager [req-6e4e22a0-1c59-4eb9-9c31-bd523379979e req-02230364-fab1-4b1f-951c-a8a003eec47d service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state rescuing.
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:58:15 user nova-compute[70375]: INFO nova.compute.claims [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Claim successful on node user
Jul 24 17:58:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.082s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.compute.claims [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Claim successful on node user
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.policy [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edc5d742d0f4dc3ba67f1fad87937ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce4fa18b04c41078f64aa0af0777e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Creating image(s)
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "/opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "/opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:16 user nova-compute[70375]: WARNING nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state rescuing.
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:16 user nova-compute[70375]: WARNING nova.compute.manager [req-463dc385-cfb1-4ba5-a314-6a0f5a10d4a4 req-abc28b13-be85-40fc-8526-663ed87d30c6 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state rescuing.
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for cc5ce8b4-e6f3-4af1-a829-7883fac5847f due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221496.690882, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Resumed (Lifecycle Event)
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c11a3401-3ba6-450d-85b4-708f18b0352e tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.190s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221496.7057405, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:16 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Started (Lifecycle Event)
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk 1073741824" returned: 0 in 0.068s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:58:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:17 user nova-compute[70375]: INFO nova.virt.block_device [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Booting with blank volume at /dev/vda
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.policy [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c1aa740b7404c2e8703488bcd87404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a644d007b4ecdbde7ec4788464675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Cannot resize image /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'migration_context' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Ensure instance console log exists: /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Successfully created port: 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:58:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Successfully created port: 6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Successfully updated port: 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquired lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-changed-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Refreshing instance network info cache due to event network-changed-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] Acquiring lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updating instance_info_cache with network_info: [{"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Releasing lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Instance network_info: |[{"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] Acquired lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Refreshing network info cache for port 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Start _get_guest_xml network_info=[{"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:58:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576968025',display_name='tempest-AttachVolumeNegativeTest-server-1576968025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576968025',id=24,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrwyruz5xqLrXeMUNJbIA1fsK8cPgvRNJgGGwavBeL1HcBfN0Shv6ezUTaCGWkI4Qp0ti5U5p2WqQloaDtKqXu+5JsOPVqx+N9KwJvCqxuGgHPn83PUC8Z5SD9lxWrGLg==',key_name='tempest-keypair-1240096683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-0u4ato4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=b28f6d6d-768a-4477-b20b-387acd129c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'pci_devices' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:58:19 user nova-compute[70375]:   <uuid>b28f6d6d-768a-4477-b20b-387acd129c18</uuid>
Jul 24 17:58:19 user nova-compute[70375]:   <name>instance-00000018</name>
Jul 24 17:58:19 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:58:19 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:58:19 user nova-compute[70375]:   <metadata>
Jul 24 17:58:19 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:58:19 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1576968025</nova:name>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:58:19</nova:creationTime>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:58:19 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:58:19 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:owner>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:user uuid="3edc5d742d0f4dc3ba67f1fad87937ac">tempest-AttachVolumeNegativeTest-777978815-project-member</nova:user>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:project uuid="7ce4fa18b04c41078f64aa0af0777e51">tempest-AttachVolumeNegativeTest-777978815</nova:project>
Jul 24 17:58:19 user nova-compute[70375]:       </nova:owner>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:58:19 user nova-compute[70375]:       <nova:ports>
Jul 24 17:58:19 user nova-compute[70375]:         <nova:port uuid="99cf6db3-1b2e-4e4f-829c-c76ff3cd344c">
Jul 24 17:58:19 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 17:58:19 user nova-compute[70375]:         </nova:port>
Jul 24 17:58:19 user nova-compute[70375]:       </nova:ports>
Jul 24 17:58:19 user nova-compute[70375]:     </nova:instance>
Jul 24 17:58:19 user nova-compute[70375]:   </metadata>
Jul 24 17:58:19 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:58:19 user nova-compute[70375]:     <system>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="serial">b28f6d6d-768a-4477-b20b-387acd129c18</entry>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="uuid">b28f6d6d-768a-4477-b20b-387acd129c18</entry>
Jul 24 17:58:19 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:58:19 user nova-compute[70375]:     </system>
Jul 24 17:58:19 user nova-compute[70375]:   </sysinfo>
Jul 24 17:58:19 user nova-compute[70375]:   <os>
Jul 24 17:58:19 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:58:19 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:58:19 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:58:19 user nova-compute[70375]:   </os>
Jul 24 17:58:19 user nova-compute[70375]:   <features>
Jul 24 17:58:19 user nova-compute[70375]:     <acpi/>
Jul 24 17:58:19 user nova-compute[70375]:     <apic/>
Jul 24 17:58:19 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:58:19 user nova-compute[70375]:   </features>
Jul 24 17:58:19 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:58:19 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:58:19 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:58:19 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:58:19 user nova-compute[70375]:   </clock>
Jul 24 17:58:19 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:58:19 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:58:19 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:58:19 user nova-compute[70375]:   </cpu>
Jul 24 17:58:19 user nova-compute[70375]:   <devices>
Jul 24 17:58:19 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:58:19 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:58:19 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk"/>
Jul 24 17:58:19 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:58:19 user nova-compute[70375]:     </disk>
Jul 24 17:58:19 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:58:19 user nova-compute[70375]:       <mac address="fa:16:3e:f1:f2:cf"/>
Jul 24 17:58:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:19 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:58:19 user nova-compute[70375]:       <target dev="tap99cf6db3-1b"/>
Jul 24 17:58:19 user nova-compute[70375]:     </interface>
Jul 24 17:58:19 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:58:19 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/console.log" append="off"/>
Jul 24 17:58:19 user nova-compute[70375]:     </serial>
Jul 24 17:58:19 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:58:19 user nova-compute[70375]:     <video>
Jul 24 17:58:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:19 user nova-compute[70375]:     </video>
Jul 24 17:58:19 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:58:19 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:58:19 user nova-compute[70375]:     </rng>
Jul 24 17:58:19 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:58:19 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:58:19 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:58:19 user nova-compute[70375]:     </memballoon>
Jul 24 17:58:19 user nova-compute[70375]:   </devices>
Jul 24 17:58:19 user nova-compute[70375]: </domain>
Jul 24 17:58:19 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576968025',display_name='tempest-AttachVolumeNegativeTest-server-1576968025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576968025',id=24,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrwyruz5xqLrXeMUNJbIA1fsK8cPgvRNJgGGwavBeL1HcBfN0Shv6ezUTaCGWkI4Qp0ti5U5p2WqQloaDtKqXu+5JsOPVqx+N9KwJvCqxuGgHPn83PUC8Z5SD9lxWrGLg==',key_name='tempest-keypair-1240096683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-0u4ato4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=b28f6d6d-768a-4477-b20b-387acd129c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG os_vif [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99cf6db3-1b, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99cf6db3-1b, col_values=(('external_ids', {'iface-id': '99cf6db3-1b2e-4e4f-829c-c76ff3cd344c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:f2:cf', 'vm-uuid': 'b28f6d6d-768a-4477-b20b-387acd129c18'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:20 user nova-compute[70375]: INFO os_vif [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b')
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:f1:f2:cf, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Successfully updated port: 6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updated VIF entry in instance network info cache for port 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updating instance_info_cache with network_info: [{"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c54ca96-c60b-4ffa-bd54-8b68288dfee3 req-3172b8fc-f5cc-4cbd-9de4-301281fbd407 service nova] Releasing lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance network_info: |[{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:58:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-changed-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Refreshing instance network info cache due to event network-changed-6875b8c9-3b0f-4193-9a70-e68e0f5a8028. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:21 user nova-compute[70375]: DEBUG nova.network.neutron [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Refreshing network info cache for port 6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] No waiting events found dispatching network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:22 user nova-compute[70375]: WARNING nova.compute.manager [req-2d255e5c-91e6-431f-a429-819a37458dbb req-9095cbdc-82c8-4d44-bf46-a1c7cf9473dd service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received unexpected event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c for instance with vm_state building and task_state spawning.
Jul 24 17:58:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG nova.network.neutron [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updated VIF entry in instance network info cache for port 6875b8c9-3b0f-4193-9a70-e68e0f5a8028. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG nova.network.neutron [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5fc39297-1a4e-485b-a785-bd8bc351692e req-ebcc734c-7656-43f8-b796-fae6fda95873 service nova] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG os_brick.utils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82772550-0554-4c13-a68e-c9e92a7350b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[621991c8-31d5-4eed-adec-85a4acd952b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a34f9-ec89-429e-a800-c397ccafb62c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192783e-4538-4268-b673-51005dd8a98a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:23 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:58:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e6b433-3b74-4287-a693-b706d21dfbc0]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG os_brick.utils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating existing volume attachment record: e016ca85-ef6e-4cd9-a766-c6560a12203e {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:58:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221504.0434582, b28f6d6d-768a-4477-b20b-387acd129c18 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] VM Resumed (Lifecycle Event)
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Instance spawned successfully.
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221504.0438366, b28f6d6d-768a-4477-b20b-387acd129c18 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] VM Started (Lifecycle Event)
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Took 7.63 seconds to spawn the instance on the hypervisor.
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:24 user nova-compute[70375]: INFO nova.compute.manager [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Took 8.53 seconds to build instance.
Jul 24 17:58:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6506885-846b-41df-b9ea-41d48e5724e0 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.646s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] No waiting events found dispatching network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:24 user nova-compute[70375]: WARNING nova.compute.manager [req-17a28b95-c3d9-4095-b346-d28fba31de65 req-ce45f44c-297a-42db-924d-96723a82b9b5 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received unexpected event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c for instance with vm_state active and task_state None.
Jul 24 17:58:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Skipping network cache update for instance because it is Building. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:58:26 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [{"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 17:58:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 17:58:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:29 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:58:29 user nova-compute[70375]: INFO nova.compute.claims [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Claim successful on node user
Jul 24 17:58:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:58:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.policy [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3685b4353c345888a4c3677ecdef3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc7f17f00748bb96e22f0a6a7429cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:58:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Creating image(s)
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "/opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "/opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "/opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.232s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk 1073741824" returned: 0 in 0.073s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:58:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Creating image(s)
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Ensure instance console log exists: /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start _get_guest_xml network_info=[{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e016ca85-ef6e-4cd9-a766-c6560a12203e', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f4dbd9f-5580-4c29-86b9-cc35d7768715', 'attached_at': '', 'detached_at': '', 'volume_id': 'a853cda1-83d4-42f3-bc65-a869f4a12d77', 'serial': 'a853cda1-83d4-42f3-bc65-a869f4a12d77'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:58:31 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:31 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:31 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:31 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:31 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43e118-bb7b-48be-bc3e-68cdde9e307f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:58:31 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0203b8-24c6-49b4-82ee-ff5bac9ff4e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77] added
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff08b0-9bd7-4417-92cd-b217ff0e5267]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a1db1-83e1-4f9b-a4f7-7bc5440159fc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvrRIYZ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvrRIYZ" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319f0e7-1061-40a6-aa70-56a6a22cc678]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtvrRIYZ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Cannot resize image /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.objects.instance [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'migration_context' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Ensure instance console log exists: /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b079ef7-b563-47e3-a589-db364162ac49]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b01caa-51a3-4d06-9cf5-7f6fca952d12]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dd231-58a8-463c-bc55-20e0048e1870]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260]
Jul 24 17:58:31 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260] successful.
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804e6c6-aab2-443d-a9db-9634684611a9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3349c-43ae-4add-a42c-7a1e27d7de39]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f70b1-1804-4982-a1d3-448512fc9203]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:58:31 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Successfully created port: 5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26636646133653963', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636646133653963', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1948242503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1948242503',id=25,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ordclwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:17Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=0f4dbd9f-5580-4c29-86b9-cc35d7768715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.objects.instance [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:58:32 user nova-compute[70375]:   <uuid>0f4dbd9f-5580-4c29-86b9-cc35d7768715</uuid>
Jul 24 17:58:32 user nova-compute[70375]:   <name>instance-00000019</name>
Jul 24 17:58:32 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:58:32 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:58:32 user nova-compute[70375]:   <metadata>
Jul 24 17:58:32 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:58:32 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1948242503</nova:name>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:58:31</nova:creationTime>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:58:32 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:58:32 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:owner>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 17:58:32 user nova-compute[70375]:       </nova:owner>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:58:32 user nova-compute[70375]:       <nova:ports>
Jul 24 17:58:32 user nova-compute[70375]:         <nova:port uuid="6875b8c9-3b0f-4193-9a70-e68e0f5a8028">
Jul 24 17:58:32 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 17:58:32 user nova-compute[70375]:         </nova:port>
Jul 24 17:58:32 user nova-compute[70375]:       </nova:ports>
Jul 24 17:58:32 user nova-compute[70375]:     </nova:instance>
Jul 24 17:58:32 user nova-compute[70375]:   </metadata>
Jul 24 17:58:32 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:58:32 user nova-compute[70375]:     <system>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="serial">0f4dbd9f-5580-4c29-86b9-cc35d7768715</entry>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="uuid">0f4dbd9f-5580-4c29-86b9-cc35d7768715</entry>
Jul 24 17:58:32 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:58:32 user nova-compute[70375]:     </system>
Jul 24 17:58:32 user nova-compute[70375]:   </sysinfo>
Jul 24 17:58:32 user nova-compute[70375]:   <os>
Jul 24 17:58:32 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:58:32 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:58:32 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:58:32 user nova-compute[70375]:   </os>
Jul 24 17:58:32 user nova-compute[70375]:   <features>
Jul 24 17:58:32 user nova-compute[70375]:     <acpi/>
Jul 24 17:58:32 user nova-compute[70375]:     <apic/>
Jul 24 17:58:32 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:58:32 user nova-compute[70375]:   </features>
Jul 24 17:58:32 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:58:32 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:58:32 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:58:32 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:58:32 user nova-compute[70375]:   </clock>
Jul 24 17:58:32 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:58:32 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:58:32 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:58:32 user nova-compute[70375]:   </cpu>
Jul 24 17:58:32 user nova-compute[70375]:   <devices>
Jul 24 17:58:32 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:58:32 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:58:32 user nova-compute[70375]:       <source dev="/dev/sdc"/>
Jul 24 17:58:32 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:58:32 user nova-compute[70375]:       <serial>a853cda1-83d4-42f3-bc65-a869f4a12d77</serial>
Jul 24 17:58:32 user nova-compute[70375]:     </disk>
Jul 24 17:58:32 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:58:32 user nova-compute[70375]:       <mac address="fa:16:3e:0c:d5:e6"/>
Jul 24 17:58:32 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:32 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:58:32 user nova-compute[70375]:       <target dev="tap6875b8c9-3b"/>
Jul 24 17:58:32 user nova-compute[70375]:     </interface>
Jul 24 17:58:32 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:58:32 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/console.log" append="off"/>
Jul 24 17:58:32 user nova-compute[70375]:     </serial>
Jul 24 17:58:32 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:58:32 user nova-compute[70375]:     <video>
Jul 24 17:58:32 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:32 user nova-compute[70375]:     </video>
Jul 24 17:58:32 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:58:32 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:58:32 user nova-compute[70375]:     </rng>
Jul 24 17:58:32 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:58:32 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:58:32 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:58:32 user nova-compute[70375]:     </memballoon>
Jul 24 17:58:32 user nova-compute[70375]:   </devices>
Jul 24 17:58:32 user nova-compute[70375]: </domain>
Jul 24 17:58:32 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1948242503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1948242503',id=25,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ordclwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:17Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=0f4dbd9f-5580-4c29-86b9-cc35d7768715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG os_vif [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6875b8c9-3b, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6875b8c9-3b, col_values=(('external_ids', {'iface-id': '6875b8c9-3b0f-4193-9a70-e68e0f5a8028', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:d5:e6', 'vm-uuid': '0f4dbd9f-5580-4c29-86b9-cc35d7768715'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:32 user nova-compute[70375]: INFO os_vif [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b')
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:0c:d5:e6, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Successfully updated port: 5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquired lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-changed-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Refreshing instance network info cache due to event network-changed-5549309b-3614-4cbc-9881-9fe88f191123. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] Acquiring lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating instance_info_cache with network_info: [{"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Releasing lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Instance network_info: |[{"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] Acquired lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Refreshing network info cache for port 5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Start _get_guest_xml network_info=[{"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:58:34 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:34 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-659321617',display_name='tempest-TestServerVolumeAttachmentScenario-server-659321617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-659321617',id=26,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaZ7LWSo/83GQkHdmgaZWKv0XN5Wn0Kmmia8a7FpGPEGtPGApEjYX76LDctry/urjFAidvB1nu6HeG9uC5Sxfi40OZ9zl7yV1pDXXxIYfxvwRVoA4wtbc+lsNfsm3PzJA==',key_name='tempest-keypair-937863538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8dc7f17f00748bb96e22f0a6a7429cc',ramdisk_id='',reservation_id='r-vxtr2dav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448539370',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448539370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3685b4353c345888a4c3677ecdef3d2',uuid=ded94bc6-f0cf-47c7-b951-617d636c8121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converting VIF {"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.objects.instance [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'pci_devices' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:58:34 user nova-compute[70375]:   <uuid>ded94bc6-f0cf-47c7-b951-617d636c8121</uuid>
Jul 24 17:58:34 user nova-compute[70375]:   <name>instance-0000001a</name>
Jul 24 17:58:34 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:58:34 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:58:34 user nova-compute[70375]:   <metadata>
Jul 24 17:58:34 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:58:34 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-659321617</nova:name>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:58:34</nova:creationTime>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:58:34 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:58:34 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:owner>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:user uuid="b3685b4353c345888a4c3677ecdef3d2">tempest-TestServerVolumeAttachmentScenario-448539370-project-member</nova:user>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:project uuid="c8dc7f17f00748bb96e22f0a6a7429cc">tempest-TestServerVolumeAttachmentScenario-448539370</nova:project>
Jul 24 17:58:34 user nova-compute[70375]:       </nova:owner>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 17:58:34 user nova-compute[70375]:       <nova:ports>
Jul 24 17:58:34 user nova-compute[70375]:         <nova:port uuid="5549309b-3614-4cbc-9881-9fe88f191123">
Jul 24 17:58:34 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:58:34 user nova-compute[70375]:         </nova:port>
Jul 24 17:58:34 user nova-compute[70375]:       </nova:ports>
Jul 24 17:58:34 user nova-compute[70375]:     </nova:instance>
Jul 24 17:58:34 user nova-compute[70375]:   </metadata>
Jul 24 17:58:34 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:58:34 user nova-compute[70375]:     <system>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="serial">ded94bc6-f0cf-47c7-b951-617d636c8121</entry>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="uuid">ded94bc6-f0cf-47c7-b951-617d636c8121</entry>
Jul 24 17:58:34 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:58:34 user nova-compute[70375]:     </system>
Jul 24 17:58:34 user nova-compute[70375]:   </sysinfo>
Jul 24 17:58:34 user nova-compute[70375]:   <os>
Jul 24 17:58:34 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:58:34 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:58:34 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:58:34 user nova-compute[70375]:   </os>
Jul 24 17:58:34 user nova-compute[70375]:   <features>
Jul 24 17:58:34 user nova-compute[70375]:     <acpi/>
Jul 24 17:58:34 user nova-compute[70375]:     <apic/>
Jul 24 17:58:34 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:58:34 user nova-compute[70375]:   </features>
Jul 24 17:58:34 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:58:34 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:58:34 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:58:34 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:58:34 user nova-compute[70375]:   </clock>
Jul 24 17:58:34 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:58:34 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:58:34 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:58:34 user nova-compute[70375]:   </cpu>
Jul 24 17:58:34 user nova-compute[70375]:   <devices>
Jul 24 17:58:34 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:58:34 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:58:34 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk"/>
Jul 24 17:58:34 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:58:34 user nova-compute[70375]:     </disk>
Jul 24 17:58:34 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:58:34 user nova-compute[70375]:       <mac address="fa:16:3e:8d:cb:76"/>
Jul 24 17:58:34 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:34 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:58:34 user nova-compute[70375]:       <target dev="tap5549309b-36"/>
Jul 24 17:58:34 user nova-compute[70375]:     </interface>
Jul 24 17:58:34 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:58:34 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/console.log" append="off"/>
Jul 24 17:58:34 user nova-compute[70375]:     </serial>
Jul 24 17:58:34 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:58:34 user nova-compute[70375]:     <video>
Jul 24 17:58:34 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:34 user nova-compute[70375]:     </video>
Jul 24 17:58:34 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:58:34 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:58:34 user nova-compute[70375]:     </rng>
Jul 24 17:58:34 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:58:34 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:58:34 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:58:34 user nova-compute[70375]:     </memballoon>
Jul 24 17:58:34 user nova-compute[70375]:   </devices>
Jul 24 17:58:34 user nova-compute[70375]: </domain>
Jul 24 17:58:34 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-659321617',display_name='tempest-TestServerVolumeAttachmentScenario-server-659321617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-659321617',id=26,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaZ7LWSo/83GQkHdmgaZWKv0XN5Wn0Kmmia8a7FpGPEGtPGApEjYX76LDctry/urjFAidvB1nu6HeG9uC5Sxfi40OZ9zl7yV1pDXXxIYfxvwRVoA4wtbc+lsNfsm3PzJA==',key_name='tempest-keypair-937863538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8dc7f17f00748bb96e22f0a6a7429cc',ramdisk_id='',reservation_id='r-vxtr2dav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448539370',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448539370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3685b4353c345888a4c3677ecdef3d2',uuid=ded94bc6-f0cf-47c7-b951-617d636c8121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converting VIF {"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG os_vif [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5549309b-36, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5549309b-36, col_values=(('external_ids', {'iface-id': '5549309b-3614-4cbc-9881-9fe88f191123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:cb:76', 'vm-uuid': 'ded94bc6-f0cf-47c7-b951-617d636c8121'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: INFO os_vif [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36')
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No VIF found with MAC fa:16:3e:8d:cb:76, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:34 user nova-compute[70375]: WARNING nova.compute.manager [req-c5f851f2-7b00-451d-ab58-694d79135224 req-0fd60ce8-e114-4856-8fac-65e456b34652 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state building and task_state spawning.
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updated VIF entry in instance network info cache for port 5549309b-3614-4cbc-9881-9fe88f191123. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG nova.network.neutron [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating instance_info_cache with network_info: [{"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bebabcf-068b-447c-a342-6bebd81cc501 req-1812e688-dfa1-4e4c-bf33-048037831895 service nova] Releasing lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] No waiting events found dispatching network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:35 user nova-compute[70375]: WARNING nova.compute.manager [req-44f8bf24-4291-4ab1-b2e2-829b31d312c3 req-a2430d3a-288b-4df2-8dfe-b0e532d681d4 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received unexpected event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 for instance with vm_state building and task_state spawning.
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:36 user nova-compute[70375]: WARNING nova.compute.manager [req-b4266c5d-87e2-4e91-a17b-6a5c2e53a13f req-e057b982-5d9f-457b-a668-aa8341cbb47c service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state building and task_state spawning.
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:58:36 user nova-compute[70375]: INFO nova.compute.claims [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Claim successful on node user
Jul 24 17:58:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.policy [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c5063436895467ca5ffae12856a1677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a342f080683d45b29897f8bf407de037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221517.3304625, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Resumed (Lifecycle Event)
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Creating image(s)
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance spawned successfully.
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221517.3314872, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Started (Lifecycle Event)
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Took 6.43 seconds to spawn the instance on the hypervisor.
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] No waiting events found dispatching network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:37 user nova-compute[70375]: WARNING nova.compute.manager [req-aecba026-18b3-478a-9e0a-cabd5b8c3e90 req-d915662b-213d-42f5-bbd0-563fa6586483 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received unexpected event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 for instance with vm_state building and task_state spawning.
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:58:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.part --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.images [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] 591c5d22-0f80-4b31-8e49-d57afcd9b746 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.part /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Successfully created port: 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Took 21.92 seconds to build instance.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be2cbd47-ffaa-4245-9544-ce4ac318a142 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.101s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221518.3056185, ded94bc6-f0cf-47c7-b951-617d636c8121 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] VM Resumed (Lifecycle Event)
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.part /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.converted" returned: 0 in 0.247s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Instance spawned successfully.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221518.3079355, ded94bc6-f0cf-47c7-b951-617d636c8121 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] VM Started (Lifecycle Event)
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Took 7.98 seconds to spawn the instance on the hypervisor.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: INFO nova.compute.manager [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Took 9.06 seconds to build instance.
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99c185ad-3cd3-4aa4-966e-a8d90c7b324d tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.200s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab,backing_fmt=raw /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab,backing_fmt=raw /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk 1073741824" returned: 0 in 0.048s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "bf9646f8bf653ccedd393193ea09353eaf9bfcab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Successfully updated port: 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-changed-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing instance network info cache due to event network-changed-216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Cannot resize image /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.objects.instance [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'migration_context' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Ensure instance console log exists: /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance network_info: |[{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start _get_guest_xml network_info=[{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:58:33Z,direct_url=<?>,disk_format='qcow2',id=591c5d22-0f80-4b31-8e49-d57afcd9b746,min_disk=0,min_ram=0,name='tempest-scenario-img--282835777',owner='a342f080683d45b29897f8bf407de037',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:58:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '591c5d22-0f80-4b31-8e49-d57afcd9b746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:58:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:58:33Z,direct_url=<?>,disk_format='qcow2',id=591c5d22-0f80-4b31-8e49-d57afcd9b746,min_disk=0,min_ram=0,name='tempest-scenario-img--282835777',owner='a342f080683d45b29897f8bf407de037',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:58:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:37Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.objects.instance [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'pci_devices' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:58:39 user nova-compute[70375]:   <uuid>55e5e70a-02e5-4363-89b3-02cef5942015</uuid>
Jul 24 17:58:39 user nova-compute[70375]:   <name>instance-0000001b</name>
Jul 24 17:58:39 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:58:39 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:58:39 user nova-compute[70375]:   <metadata>
Jul 24 17:58:39 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:58:39 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:name>tempest-TestMinimumBasicScenario-server-737970939</nova:name>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:58:39</nova:creationTime>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:58:39 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:58:39 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:owner>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:user uuid="2c5063436895467ca5ffae12856a1677">tempest-TestMinimumBasicScenario-1073066154-project-member</nova:user>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:project uuid="a342f080683d45b29897f8bf407de037">tempest-TestMinimumBasicScenario-1073066154</nova:project>
Jul 24 17:58:39 user nova-compute[70375]:       </nova:owner>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:root type="image" uuid="591c5d22-0f80-4b31-8e49-d57afcd9b746"/>
Jul 24 17:58:39 user nova-compute[70375]:       <nova:ports>
Jul 24 17:58:39 user nova-compute[70375]:         <nova:port uuid="216d7d69-3422-4e84-8525-4494e06baa85">
Jul 24 17:58:39 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 17:58:39 user nova-compute[70375]:         </nova:port>
Jul 24 17:58:39 user nova-compute[70375]:       </nova:ports>
Jul 24 17:58:39 user nova-compute[70375]:     </nova:instance>
Jul 24 17:58:39 user nova-compute[70375]:   </metadata>
Jul 24 17:58:39 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:58:39 user nova-compute[70375]:     <system>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="serial">55e5e70a-02e5-4363-89b3-02cef5942015</entry>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="uuid">55e5e70a-02e5-4363-89b3-02cef5942015</entry>
Jul 24 17:58:39 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:58:39 user nova-compute[70375]:     </system>
Jul 24 17:58:39 user nova-compute[70375]:   </sysinfo>
Jul 24 17:58:39 user nova-compute[70375]:   <os>
Jul 24 17:58:39 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:58:39 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:58:39 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:58:39 user nova-compute[70375]:   </os>
Jul 24 17:58:39 user nova-compute[70375]:   <features>
Jul 24 17:58:39 user nova-compute[70375]:     <acpi/>
Jul 24 17:58:39 user nova-compute[70375]:     <apic/>
Jul 24 17:58:39 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:58:39 user nova-compute[70375]:   </features>
Jul 24 17:58:39 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:58:39 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:58:39 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:58:39 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:58:39 user nova-compute[70375]:   </clock>
Jul 24 17:58:39 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:58:39 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:58:39 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:58:39 user nova-compute[70375]:   </cpu>
Jul 24 17:58:39 user nova-compute[70375]:   <devices>
Jul 24 17:58:39 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 17:58:39 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 17:58:39 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk"/>
Jul 24 17:58:39 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:58:39 user nova-compute[70375]:     </disk>
Jul 24 17:58:39 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:58:39 user nova-compute[70375]:       <mac address="fa:16:3e:32:50:6c"/>
Jul 24 17:58:39 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:39 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:58:39 user nova-compute[70375]:       <target dev="tap216d7d69-34"/>
Jul 24 17:58:39 user nova-compute[70375]:     </interface>
Jul 24 17:58:39 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:58:39 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/console.log" append="off"/>
Jul 24 17:58:39 user nova-compute[70375]:     </serial>
Jul 24 17:58:39 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:58:39 user nova-compute[70375]:     <video>
Jul 24 17:58:39 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:58:39 user nova-compute[70375]:     </video>
Jul 24 17:58:39 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:58:39 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:58:39 user nova-compute[70375]:     </rng>
Jul 24 17:58:39 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:58:39 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:58:39 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:58:39 user nova-compute[70375]:     </memballoon>
Jul 24 17:58:39 user nova-compute[70375]:   </devices>
Jul 24 17:58:39 user nova-compute[70375]: </domain>
Jul 24 17:58:39 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:37Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG os_vif [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap216d7d69-34, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap216d7d69-34, col_values=(('external_ids', {'iface-id': '216d7d69-3422-4e84-8525-4494e06baa85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:50:6c', 'vm-uuid': '55e5e70a-02e5-4363-89b3-02cef5942015'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:39 user nova-compute[70375]: INFO os_vif [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34')
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No VIF found with MAC fa:16:3e:32:50:6c, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updated VIF entry in instance network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-bdfbe3e5-9108-4550-b7dd-9bc9fd0322b4 req-bd4f22ee-ee06-4d2e-a3cb-4456edac30a2 service nova] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221523.2118938, 55e5e70a-02e5-4363-89b3-02cef5942015 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] VM Resumed (Lifecycle Event)
Jul 24 17:58:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:43 user nova-compute[70375]: WARNING nova.compute.manager [req-2d67b690-1991-40a6-91c5-757900ef85b5 req-1ea8c105-fe50-41c2-aba9-e9231db55c60 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state building and task_state spawning.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:58:43 user nova-compute[70375]: WARNING nova.compute.manager [req-92ca4186-7091-4e50-8d05-fc4b7837674a req-0ef6c2cb-59cf-4912-826b-158b496f69dc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state building and task_state spawning.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=24.380474090576172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance spawned successfully.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221523.2127583, 55e5e70a-02e5-4363-89b3-02cef5942015 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] VM Started (Lifecycle Event)
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Took 6.39 seconds to spawn the instance on the hypervisor.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b28f6d6d-768a-4477-b20b-387acd129c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ded94bc6-f0cf-47c7-b951-617d636c8121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:58:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:58:43 user nova-compute[70375]: INFO nova.compute.manager [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Took 7.54 seconds to build instance.
Jul 24 17:58:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-96e5e1aa-8470-4880-83cf-c335891eab62 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.640s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 17:58:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:49 user nova-compute[70375]: INFO nova.compute.manager [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attaching volume 97448363-8496-4be0-99a2-ce949b8f7c47 to /dev/vdb
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.utils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ad9a4-19cb-4ef5-a4cd-7dd7bf8f4d40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed557d11-d7e3-462b-9597-53cf0e25abab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b54e10e-818f-4d2f-b5e0-9da5a148cafb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6da00-915b-4a52-b898-ba3ebe61b1ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:58:49 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:58:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d2a52-4488-4381-bbbb-16240e9cb67c]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG os_brick.utils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating existing volume attachment record: 49af9f65-b5de-495b-a8e3-89b0db7bbbed {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:58:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-changed-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:58:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Refreshing instance network info cache due to event network-changed-a05d138d-5697-4845-abef-b690c3032e5d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:58:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] Acquiring lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:58:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] Acquired lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:58:52 user nova-compute[70375]: DEBUG nova.network.neutron [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Refreshing network info cache for port a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:58:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updated VIF entry in instance network info cache for port a05d138d-5697-4845-abef-b690c3032e5d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:58:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updating instance_info_cache with network_info: [{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:58:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c4ac6a24-7213-4481-8a15-54bdb1dde728 req-e6105d1a-2aa0-4178-8c71-361007dd3274 service nova] Releasing lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:58:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyLcZxIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:58:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:58:55 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badfd26-ba5e-43b0-9422-8259ef899af8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:58:55 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741aaeb-fb1a-41c2-8fd4-981b316eebf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47] added
Jul 24 17:58:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa8da2-98b0-43dd-af47-ca4ce9a80602]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b26b2-df1e-49f3-b8c1-d575b9d399a0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyLcZxIk {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyLcZxIk" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d445f9-c0b7-4632-aa65-0c0197c2ccb7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyLcZxIk'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a1ee8-ba6a-41c4-a353-e8b65ee6e4d0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1e3f2-40bb-414e-93ae-8ecfa83c8a0c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96726d7-ec92-41ec-93ae-bda0d37e8088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260]
Jul 24 17:58:56 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260] successful.
Jul 24 17:58:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5bd5e2-5611-4aee-953f-dd12fc73f92f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee19c3-bff2-4ea0-b33e-968b3abb40fe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)
Jul 24 17:58:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69628e2-d19e-4f58-a618-216feb68fc65]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:58:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyLcZxIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23336626635653938', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336626635653938', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 17:58:57 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:58:57 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 17:58:57 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:58:57 user nova-compute[70375]:   <serial>97448363-8496-4be0-99a2-ce949b8f7c47</serial>
Jul 24 17:58:57 user nova-compute[70375]: </disk>
Jul 24 17:58:57 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No VIF found with MAC fa:16:3e:fa:aa:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:58:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dc29dbe8-1411-4438-8b7f-a3f3e6779087 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.753s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:58:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:58:59 user nova-compute[70375]: INFO nova.compute.claims [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Claim successful on node user
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:59:00 user nova-compute[70375]: INFO nova.compute.manager [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Detaching volume 97448363-8496-4be0-99a2-ce949b8f7c47
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:59:00 user nova-compute[70375]: INFO nova.virt.block_device [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attempting to driver detach volume 97448363-8496-4be0-99a2-ce949b8f7c47 from mountpoint /dev/vdb
Jul 24 17:59:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Attempting to detach device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:59:00 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:59:00 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 17:59:00 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:59:00 user nova-compute[70375]:   <serial>97448363-8496-4be0-99a2-ce949b8f7c47</serial>
Jul 24 17:59:00 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:59:00 user nova-compute[70375]: </disk>
Jul 24 17:59:00 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:59:00 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config.
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:59:00 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:59:00 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 17:59:00 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:59:00 user nova-compute[70375]:   <serial>97448363-8496-4be0-99a2-ce949b8f7c47</serial>
Jul 24 17:59:00 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 17:59:00 user nova-compute[70375]: </disk>
Jul 24 17:59:00 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:59:00 user nova-compute[70375]: INFO nova.virt.block_device [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Booting with volume 9e28b1f5-6ef3-4050-897d-ab56781c4efe at /dev/vda
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.policy [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1395e4ee5bd4408783d423729093834d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa85032ee2074843ab0c0a4d27947eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.utils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[668dddff-2545-4b50-b402-a7b32a619dbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30317d-cb97-4238-98ad-6e3d99b6c35b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b589d8-aa33-4d55-9b9d-8994970942e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2cf8a2-bc46-4644-83cb-a5ef81f818c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:59:00 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:59:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7583d8bc-9378-4b42-b1a9-e5b22d896f53]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG os_brick.utils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:59:00 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating existing volume attachment record: ec68964b-9b3b-4308-a9c4-cfd7b5a90314 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221541.1089919, c97c022f-1bca-4f38-b876-604724ed6442 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:59:01 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config.
Jul 24 17:59:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyLcZxIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:59:01 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99fa29f-b8dd-4d45-b7b0-a65ff332c55c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:59:01 user nova-compute[70375]: No targets found.
Jul 24 17:59:01 user nova-compute[70375]: iSNS:
Jul 24 17:59:01 user nova-compute[70375]: No targets found.
Jul 24 17:59:01 user nova-compute[70375]: STATIC:
Jul 24 17:59:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47
Jul 24 17:59:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 17:59:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:59:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 17:59:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:01 user nova-compute[70375]: FIRMWARE:
Jul 24 17:59:01 user nova-compute[70375]: No targets found.
Jul 24 17:59:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:59:01 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:59:01 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fba01be-fc07-49fd-9949-e456c2f0f20d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98960d9-2168-4480-afaf-bfb1fd08a048]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 (non-flash)
Jul 24 17:59:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6501ba9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0220fa-bda4-40c9-ac64-d907d825cd82]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d4c8cf-9717-429c-afcb-d44e3de3f9f1]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23500ad-d0da-4091-936f-ee0f1390c533]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f94ec8-ade7-497a-b4df-970bba9170b7]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8019f4a0-343a-4d11-a58f-473f92442ab9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[782aa78f-6691-4ea5-9042-254bacd10638]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260]
Jul 24 17:59:01 user nova-compute[70375]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47, portal: 172.16.0.220,3260] successful.
Jul 24 17:59:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Successfully created port: ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97448363-8496-4be0-99a2-ce949b8f7c47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c0547-b303-4b2b-b730-21caf7e6e0c8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== disconnect_volume: return (350ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:59:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Successfully updated port: ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquired lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-eca14c2d-29cd-440d-be5f-da208d1f2f9b tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.761s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-changed-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Refreshing instance network info cache due to event network-changed-ebd5e8e5-a090-4885-a9da-91f048168fde. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] Acquiring lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating instance_info_cache with network_info: [{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Releasing lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance network_info: |[{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] Acquired lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:59:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Refreshing network info cache for port ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:59:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updated VIF entry in instance network info cache for port ebd5e8e5-a090-4885-a9da-91f048168fde. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:59:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating instance_info_cache with network_info: [{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:59:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1171180a-bd91-4f66-adcb-7e50da9e688a req-e0abca40-df4e-4571-97bb-c9a0cc7ede93 service nova] Releasing lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:59:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:05 user nova-compute[70375]: INFO nova.compute.manager [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Detaching volume 78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:59:05 user nova-compute[70375]: INFO nova.virt.block_device [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Attempting to driver detach volume 78cff04d-f365-4b90-9b96-37b556e2c234 from mountpoint /dev/vdb
Jul 24 17:59:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Attempting to detach device vdb from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 17:59:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:59:05 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:59:05 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:59:05 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:59:05 user nova-compute[70375]:   <serial>78cff04d-f365-4b90-9b96-37b556e2c234</serial>
Jul 24 17:59:05 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 17:59:05 user nova-compute[70375]: </disk>
Jul 24 17:59:05 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:59:05 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully detached device vdb from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the persistent domain config.
Jul 24 17:59:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 17:59:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 17:59:05 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:59:05 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 17:59:05 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 17:59:05 user nova-compute[70375]:   <serial>78cff04d-f365-4b90-9b96-37b556e2c234</serial>
Jul 24 17:59:05 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 17:59:05 user nova-compute[70375]: </disk>
Jul 24 17:59:05 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221546.4188094, 9228b8cf-e00a-4a57-9762-3e9063199d63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 17:59:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully detached device vdb from instance 9228b8cf-e00a-4a57-9762-3e9063199d63 from the live domain config.
Jul 24 17:59:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMzQmxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:59:06 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cc6d3-e144-4ff2-a5a3-b7269f7eb07a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:59:06 user nova-compute[70375]: No targets found.
Jul 24 17:59:06 user nova-compute[70375]: iSNS:
Jul 24 17:59:06 user nova-compute[70375]: No targets found.
Jul 24 17:59:06 user nova-compute[70375]: STATIC:
Jul 24 17:59:06 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 17:59:06 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:06 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:06 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234
Jul 24 17:59:06 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:06 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:06 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 17:59:06 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:59:06 user nova-compute[70375]:                 Iface Name: default
Jul 24 17:59:06 user nova-compute[70375]: FIRMWARE:
Jul 24 17:59:06 user nova-compute[70375]: No targets found.
Jul 24 17:59:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:59:06 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:59:06 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4ba49-3814-42a1-b5b4-58fde83baaff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d9404-88a2-41a5-a1ea-46c96d6d7283]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630630ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9818e8-b9c4-4ef7-b66b-9844086a5921]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80b2ce4-71af-4e0c-8581-27a74fc456bf]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f5339-d759-43e3-8aed-3e5b06e1be87]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e6442-8d4e-4c61-97be-82d0e76e2fc6]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2931d-51c8-4feb-9685-d272042e80bb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685988e-fae3-438b-b4db-ccbfb8489c40]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260]
Jul 24 17:59:06 user nova-compute[70375]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234, portal: 172.16.0.220,3260] successful.
Jul 24 17:59:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cff04d-f365-4b90-9b96-37b556e2c234 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2613a575-2348-4101-be83-e5509f52b6c8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== disconnect_volume: return (299ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:59:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'flavor' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1d1548e5-5aa6-4183-8607-34db40a3f0a6 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:59:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Creating image(s)
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Ensure instance console log exists: /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start _get_guest_xml network_info=[{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ec68964b-9b3b-4308-a9c4-cfd7b5a90314', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8a8c993-c271-42b4-9c7a-111a23961f19', 'attached_at': '', 'detached_at': '', 'volume_id': '9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'serial': '9e28b1f5-6ef3-4050-897d-ab56781c4efe'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:59:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:59:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:59:07 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:59:07 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:59:07 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9e26a-85cc-47cf-867e-5e9699cb401a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:59:07 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae46cc4d-8d99-4a34-8d46-84881ba6c3f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe] added
Jul 24 17:59:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c456dbd-38b6-4995-aa94-7186b4cb345e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9dd87-eca0-424d-a197-da1dc8e2ff36]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcdhHNOl {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcdhHNOl" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761d6e9-f9f8-4115-aeff-01134aa4c52e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcdhHNOl'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[575b07be-1860-4657-b61c-36b32a78867c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aaa7f7-dd1f-4c98-a198-d93eb1713725]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c810e11-42ca-4c60-947c-6e29d2f9f8aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]
Jul 24 17:59:08 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.
Jul 24 17:59:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27550ab-2ea5-4ff6-bb15-1a7f948ae48b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54790e-523a-4cbd-aa02-8999e543fc13]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 17:59:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 17:59:08 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 17:59:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff71cdd1-ab50-4c99-bbb2-51dfdb97f359]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:59:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23065633165613530', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633165613530', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2029243753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'pci_devices' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:59:09 user nova-compute[70375]:   <uuid>d8a8c993-c271-42b4-9c7a-111a23961f19</uuid>
Jul 24 17:59:09 user nova-compute[70375]:   <name>instance-0000001c</name>
Jul 24 17:59:09 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 17:59:09 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 17:59:09 user nova-compute[70375]:   <metadata>
Jul 24 17:59:09 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:59:09 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 17:59:09 user nova-compute[70375]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2029243753</nova:name>
Jul 24 17:59:09 user nova-compute[70375]:       <nova:creationTime>2023-07-24 17:59:07</nova:creationTime>
Jul 24 17:59:09 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 17:59:09 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:59:09 user nova-compute[70375]:       </nova:flavor>
Jul 24 17:59:09 user nova-compute[70375]:       <nova:owner>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:user uuid="1395e4ee5bd4408783d423729093834d">tempest-ServerActionsV293TestJSON-1282122326-project-member</nova:user>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:project uuid="aa85032ee2074843ab0c0a4d27947eda">tempest-ServerActionsV293TestJSON-1282122326</nova:project>
Jul 24 17:59:09 user nova-compute[70375]:       </nova:owner>
Jul 24 17:59:09 user nova-compute[70375]:       <nova:ports>
Jul 24 17:59:09 user nova-compute[70375]:         <nova:port uuid="ebd5e8e5-a090-4885-a9da-91f048168fde">
Jul 24 17:59:09 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 17:59:09 user nova-compute[70375]:         </nova:port>
Jul 24 17:59:09 user nova-compute[70375]:       </nova:ports>
Jul 24 17:59:09 user nova-compute[70375]:     </nova:instance>
Jul 24 17:59:09 user nova-compute[70375]:   </metadata>
Jul 24 17:59:09 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 17:59:09 user nova-compute[70375]:     <system>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="serial">d8a8c993-c271-42b4-9c7a-111a23961f19</entry>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="uuid">d8a8c993-c271-42b4-9c7a-111a23961f19</entry>
Jul 24 17:59:09 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:59:09 user nova-compute[70375]:     </system>
Jul 24 17:59:09 user nova-compute[70375]:   </sysinfo>
Jul 24 17:59:09 user nova-compute[70375]:   <os>
Jul 24 17:59:09 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:59:09 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 17:59:09 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 17:59:09 user nova-compute[70375]:   </os>
Jul 24 17:59:09 user nova-compute[70375]:   <features>
Jul 24 17:59:09 user nova-compute[70375]:     <acpi/>
Jul 24 17:59:09 user nova-compute[70375]:     <apic/>
Jul 24 17:59:09 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 17:59:09 user nova-compute[70375]:   </features>
Jul 24 17:59:09 user nova-compute[70375]:   <clock offset="utc">
Jul 24 17:59:09 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:59:09 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:59:09 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 17:59:09 user nova-compute[70375]:   </clock>
Jul 24 17:59:09 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 17:59:09 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 17:59:09 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:59:09 user nova-compute[70375]:   </cpu>
Jul 24 17:59:09 user nova-compute[70375]:   <devices>
Jul 24 17:59:09 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 17:59:09 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:59:09 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 17:59:09 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 17:59:09 user nova-compute[70375]:       <serial>9e28b1f5-6ef3-4050-897d-ab56781c4efe</serial>
Jul 24 17:59:09 user nova-compute[70375]:     </disk>
Jul 24 17:59:09 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 17:59:09 user nova-compute[70375]:       <mac address="fa:16:3e:6c:8e:92"/>
Jul 24 17:59:09 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:59:09 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 17:59:09 user nova-compute[70375]:       <target dev="tapebd5e8e5-a0"/>
Jul 24 17:59:09 user nova-compute[70375]:     </interface>
Jul 24 17:59:09 user nova-compute[70375]:     <serial type="pty">
Jul 24 17:59:09 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19/console.log" append="off"/>
Jul 24 17:59:09 user nova-compute[70375]:     </serial>
Jul 24 17:59:09 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:59:09 user nova-compute[70375]:     <video>
Jul 24 17:59:09 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 17:59:09 user nova-compute[70375]:     </video>
Jul 24 17:59:09 user nova-compute[70375]:     <rng model="virtio">
Jul 24 17:59:09 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:59:09 user nova-compute[70375]:     </rng>
Jul 24 17:59:09 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:59:09 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 17:59:09 user nova-compute[70375]:       <stats period="10"/>
Jul 24 17:59:09 user nova-compute[70375]:     </memballoon>
Jul 24 17:59:09 user nova-compute[70375]:   </devices>
Jul 24 17:59:09 user nova-compute[70375]: </domain>
Jul 24 17:59:09 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2029243753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG os_vif [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd5e8e5-a0, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebd5e8e5-a0, col_values=(('external_ids', {'iface-id': 'ebd5e8e5-a090-4885-a9da-91f048168fde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:8e:92', 'vm-uuid': 'd8a8c993-c271-42b4-9c7a-111a23961f19'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:09 user nova-compute[70375]: INFO os_vif [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0')
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:59:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No VIF found with MAC fa:16:3e:6c:8e:92, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:59:10 user nova-compute[70375]: WARNING nova.compute.manager [req-1326eee5-6a38-4144-9af7-f3d32697b696 req-12fca643-5e9d-40ed-bce3-e51d9d51047b service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state building and task_state spawning.
Jul 24 17:59:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221552.6183317, d8a8c993-c271-42b4-9c7a-111a23961f19 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Resumed (Lifecycle Event)
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance spawned successfully.
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221552.621553, d8a8c993-c271-42b4-9c7a-111a23961f19 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Started (Lifecycle Event)
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Took 4.95 seconds to spawn the instance on the hypervisor.
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:59:12 user nova-compute[70375]: WARNING nova.compute.manager [req-0c45330b-cff1-40dd-9444-a9d88038f182 req-fa0816d4-1295-4b3f-9bdd-6e8dd4889b2c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state building and task_state spawning.
Jul 24 17:59:12 user nova-compute[70375]: INFO nova.compute.manager [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Took 12.84 seconds to build instance.
Jul 24 17:59:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4985ec1c-1b70-4b2c-9d1b-20da964945a1 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.925s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:59:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [{"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-f45c7f1d-bb87-42a6-a988-97d80a96225b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:59:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:59:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:59:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:59:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=24.231311798095703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b28f6d6d-768a-4477-b20b-387acd129c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ded94bc6-f0cf-47c7-b951-617d636c8121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d8a8c993-c271-42b4-9c7a-111a23961f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:59:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:59:55 user nova-compute[70375]: INFO nova.compute.manager [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attaching volume 51b7819e-360a-404f-8ff3-b6b93a01ee4f to /dev/vdb
Jul 24 17:59:55 user nova-compute[70375]: DEBUG os_brick.utils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:59:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f04c67-d4f6-4fd8-94d3-58920b0a0c18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[593059b5-a4b7-48fe-9489-6d4f348d55a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a1d30-99ca-48d5-8ceb-6c2c12064699]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[868be7c5-aa96-4f5c-8955-f58e86218bcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:59:56 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:59:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43aaa99-f9ff-4c32-84a1-d386cd968293]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG os_brick.utils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:59:56 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating existing volume attachment record: e2fbce90-713c-402a-91ae-979dfa48cfed {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:59:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:01 user nova-compute[70375]: INFO nova.compute.manager [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Unrescuing
Jul 24 18:00:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'flavor' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeHMfCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:02 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[42720970-15f9-4682-bb15-7d4ff0265a4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:00:02 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[142fc72b-a63f-4b97-880e-46aac673ed0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f] added
Jul 24 18:00:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc8fcb-6a09-4b04-99a8-49b9dc735e3b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ed774-bebd-4683-adae-ff80cd5e3907]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:02 user nova-compute[70375]: WARNING nova.compute.manager [req-b177b683-a976-4020-b217-69fab262361b req-71a8d4e4-9d37-42f8-bc2f-a1f0294c6afd service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoeHMfCX {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoeHMfCX" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021c098-7434-4d17-8920-836ccb563f0c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aoeHMfCX'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3db24a-e370-47c0-8fe1-96561cbdff9a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5123a-d46e-47ca-9a49-c9663cfd6402]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:02 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:02 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:02 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:02 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5245099c-819b-445d-bd59-ec16ae36a516]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260]
Jul 24 18:00:02 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[464ea055-ba13-445f-a889-ffc985628b91]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bebf205-9ea5-4d4a-9635-ac7d4147b9c4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)
Jul 24 18:00:03 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:03 user nova-compute[70375]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)
Jul 24 18:00:03 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37724f1-e7a3-4aa4-88ce-08ed03e05634]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeHMfCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance destroyed successfully.
Jul 24 18:00:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23363353937616366', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363353937616366', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:00:04 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:04 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:04 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:04 user nova-compute[70375]:   <serial>51b7819e-360a-404f-8ff3-b6b93a01ee4f</serial>
Jul 24 18:00:04 user nova-compute[70375]: </disk>
Jul 24 18:00:04 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] No VIF found with MAC fa:16:3e:fa:aa:7f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e7eabe48-14d1-4667-bc42-2e48e561b33f tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.940s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:05 user nova-compute[70375]: WARNING nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:05 user nova-compute[70375]: WARNING nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:05 user nova-compute[70375]: WARNING nova.compute.manager [req-6ab41933-fbae-4cd8-a636-3b8fc37b7ce3 req-24f5ac50-8be6-470f-8746-082591fb1693 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:00:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for cc5ce8b4-e6f3-4af1-a829-7883fac5847f due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221606.7906425, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:00:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Resumed (Lifecycle Event)
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8f158e10-7c5a-47c3-a57a-a95f7b2c27b9 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-changed-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Refreshing instance network info cache due to event network-changed-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] Acquiring lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] Acquired lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Refreshing network info cache for port 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:00:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221606.7928152, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:00:06 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Started (Lifecycle Event)
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:00:06 user nova-compute[70375]: INFO nova.compute.manager [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Rescuing
Jul 24 18:00:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:07 user nova-compute[70375]: INFO nova.compute.manager [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Detaching volume 51b7819e-360a-404f-8ff3-b6b93a01ee4f
Jul 24 18:00:07 user nova-compute[70375]: INFO nova.virt.block_device [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Attempting to driver detach volume 51b7819e-360a-404f-8ff3-b6b93a01ee4f from mountpoint /dev/vdb
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Attempting to detach device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:07 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:07 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:07 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:07 user nova-compute[70375]:   <serial>51b7819e-360a-404f-8ff3-b6b93a01ee4f</serial>
Jul 24 18:00:07 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:00:07 user nova-compute[70375]: </disk>
Jul 24 18:00:07 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the persistent domain config.
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:07 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:07 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:07 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:07 user nova-compute[70375]:   <serial>51b7819e-360a-404f-8ff3-b6b93a01ee4f</serial>
Jul 24 18:00:07 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:00:07 user nova-compute[70375]: </disk>
Jul 24 18:00:07 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221607.772803, c97c022f-1bca-4f38-b876-604724ed6442 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:00:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully detached device vdb from instance c97c022f-1bca-4f38-b876-604724ed6442 from the live domain config.
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeHMfCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:07 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367ebbb-cda8-484f-be99-581e6e01bb05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:00:07 user nova-compute[70375]: No targets found.
Jul 24 18:00:07 user nova-compute[70375]: iSNS:
Jul 24 18:00:07 user nova-compute[70375]: No targets found.
Jul 24 18:00:07 user nova-compute[70375]: STATIC:
Jul 24 18:00:07 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:00:07 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:07 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:07 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f
Jul 24 18:00:07 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:07 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:07 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:00:07 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:07 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:07 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:07 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:07 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:07 user nova-compute[70375]: FIRMWARE:
Jul 24 18:00:07 user nova-compute[70375]: No targets found.
Jul 24 18:00:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:00:07 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:00:07 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updated VIF entry in instance network info cache for port 99cf6db3-1b2e-4e4f-829c-c76ff3cd344c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updating instance_info_cache with network_info: [{"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1ce23990-b0ab-4258-8400-dbae1daa8912 req-55827625-5076-476b-ae20-52ba7c70e6db service nova] Releasing lock "refresh_cache-b28f6d6d-768a-4477-b20b-387acd129c18" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907e0ab-5894-4dcd-a03c-db10efffcd06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed656e4-2484-47d2-949e-ed0c0963e90f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)
Jul 24 18:00:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:07 user nova-compute[70375]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f (non-flash)
Jul 24 18:00:07 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483d0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d001d3-3eac-463c-821f-d30e0d4d5e22]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34a9d8-3abd-422e-93fc-d027fd6613dd]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a897602-3df0-4389-8505-7d6b5b2185d6]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:00:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a0309-aeff-4ff1-a9c9-9b6eff5ca3b3]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d7494-bf09-4be7-b805-eb036d959c86]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d1c9d-8ed8-4264-8143-d4657a780d48]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260]
Jul 24 18:00:08 user nova-compute[70375]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:08 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51b7819e-360a-404f-8ff3-b6b93a01ee4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f51931-d6e1-44e3-ae77-d2bd0e80e8c0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] <== disconnect_volume: return (406ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:08 user nova-compute[70375]: WARNING nova.compute.manager [req-ee0f5cfb-4013-4ee7-986b-5ad121af5c5d req-b632d73b-ca30-459d-8be3-6530c18ebe7b service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state rescuing.
Jul 24 18:00:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance destroyed successfully.
Jul 24 18:00:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Attempting a stable device rescue
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 18:00:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Creating image(s)
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "8ee78cb2a683758976554472eb1b225a871645b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "8ee78cb2a683758976554472eb1b225a871645b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'flavor' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c7e16436-ac4a-4e26-97b7-546faa9dd1fe tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.090s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.part --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.virt.images [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] 035c23be-4967-4d10-b830-f6bb90d24688 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.part /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.part /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.converted" returned: 0 in 0.436s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "8ee78cb2a683758976554472eb1b225a871645b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.943s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "8ee78cb2a683758976554472eb1b225a871645b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "8ee78cb2a683758976554472eb1b225a871645b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:10 user nova-compute[70375]: WARNING nova.compute.manager [req-746a5673-ef94-4409-8287-f9728e9fe9fe req-3973aeea-2c36-4c0c-b5e0-7b53fbac033d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state rescuing.
Jul 24 18:00:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0 --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0,backing_fmt=raw /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0,backing_fmt=raw /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue" returned: 0 in 0.053s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "8ee78cb2a683758976554472eb1b225a871645b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'migration_context' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start _get_guest_xml network_info=[{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:0c:d5:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '035c23be-4967-4d10-b830-f6bb90d24688', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e016ca85-ef6e-4cd9-a766-c6560a12203e', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0f4dbd9f-5580-4c29-86b9-cc35d7768715', 'attached_at': '', 'detached_at': '', 'volume_id': 'a853cda1-83d4-42f3-bc65-a869f4a12d77', 'serial': 'a853cda1-83d4-42f3-bc65-a869f4a12d77'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:11 user nova-compute[70375]: INFO nova.compute.manager [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Attaching volume 90aa8315-6d46-407f-aca6-86f757f06472 to /dev/vdb
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:00:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.utils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:11 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:11 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:11 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[34798b4c-1c79-427b-b705-f22a2efd4810]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123e0b5-2507-4e72-ad4e-752b3d85d6ca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UtvrRIYZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 18:00:11 user nova-compute[70375]: node.name = iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:11 user nova-compute[70375]: node.tpgt = -1
Jul 24 18:00:11 user nova-compute[70375]: node.startup = automatic
Jul 24 18:00:11 user nova-compute[70375]: node.leading_login = No
Jul 24 18:00:11 user nova-compute[70375]: iface.iscsi_ifacename = default
Jul 24 18:00:11 user nova-compute[70375]: iface.net_ifacename = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.ipaddress = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.prefix_len = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.hwaddress = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.transport_name = tcp
Jul 24 18:00:11 user nova-compute[70375]: iface.initiatorname = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.vlan_id = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.vlan_priority = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.vlan_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.iface_num = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.mtu = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.port = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.bootproto = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.subnet_mask = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.gateway = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_alt_client_id = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_dns = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_learn_iqn = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_vendor_id_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_vendor_id = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.dhcp_slp_da = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.fragmentation = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.gratuitous_arp = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.incoming_forwarding = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.tos_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.tos = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.ttl = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.delayed_ack = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.tcp_nagle = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.tcp_wsf_state = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.tcp_wsf = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.tcp_timer_scale = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.tcp_timestamp = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.redirect = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.def_task_mgmt_timeout = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.header_digest = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.data_digest = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.immediate_data = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.initial_r2t = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.data_seq_inorder = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.data_pdu_inorder = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.erl = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.max_receive_data_len = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.first_burst_len = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.max_outstanding_r2t = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.max_burst_len = 0
Jul 24 18:00:11 user nova-compute[70375]: iface.chap_auth = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.bidi_chap = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.strict_login_compliance = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.discovery_auth = <empty>
Jul 24 18:00:11 user nova-compute[70375]: iface.discovery_logout = <empty>
Jul 24 18:00:11 user nova-compute[70375]: node.discovery_address = <empty>
Jul 24 18:00:11 user nova-compute[70375]: node.discovery_port = 0
Jul 24 18:00:11 user nova-compute[70375]: node.discovery_type = static
Jul 24 18:00:11 user nova-compute[70375]: node.session.initial_cmdsn = 0
Jul 24 18:00:11 user nova-compute[70375]: node.session.initial_login_retry_max = 8
Jul 24 18:00:11 user nova-compute[70375]: node.session.xmit_thread_priority = -20
Jul 24 18:00:11 user nova-compute[70375]: node.session.cmds_max = 128
Jul 24 18:00:11 user nova-compute[70375]: node.session.queue_depth = 32
Jul 24 18:00:11 user nova-compute[70375]: node.session.nr_sessions = 1
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.authmethod = CHAP
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.username = UtvrRIYZ
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.password = ***
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.username_in = <empty>
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.password_in = <empty>
Jul 24 18:00:11 user nova-compute[70375]: node.session.auth.chap_algs = MD5
Jul 24 18:00:11 user nova-compute[70375]: node.session.timeo.replacement_timeout = 120
Jul 24 18:00:11 user nova-compute[70375]: node.session.err_timeo.abort_timeout = 15
Jul 24 18:00:11 user nova-compute[70375]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 18:00:11 user nova-compute[70375]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 18:00:11 user nova-compute[70375]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.FastAbort = Yes
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.InitialR2T = No
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.ImmediateData = Yes
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.MaxConnections = 1
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 18:00:11 user nova-compute[70375]: node.session.iscsi.ERL = 0
Jul 24 18:00:11 user nova-compute[70375]: node.session.scan = manual
Jul 24 18:00:11 user nova-compute[70375]: node.session.reopen_max = 0
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].address = 172.16.0.220
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].port = 3260
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].startup = manual
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].tcp.window_size = 524288
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].tcp.type_of_service = 0
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].timeo.logout_timeout = 15
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].timeo.login_timeout = 15
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].timeo.auth_timeout = 45
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.DataDigest = None
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.IFMarker = No
Jul 24 18:00:11 user nova-compute[70375]: node.conn[0].iscsi.OFMarker = No
Jul 24 18:00:11 user nova-compute[70375]: # END RECORD
Jul 24 18:00:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e991c1-9896-4a95-8fcb-f879ab021629]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[289952a7-2789-4e39-bfdd-ed5b52e7ee63]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c0150-52e6-454f-a9a1-4daf5c53a6cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[df155631-ac35-4f7c-be6e-f99cef3e9f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d3026-dedb-49ac-af7e-30e3701d678a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvrRIYZ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:11 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72e343-eebe-4ca0-a982-e42732b792dc]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.utils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updating existing volume attachment record: da9d41fb-8f62-44b5-af05-04556eea753f {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvrRIYZ" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69d65f1-5de6-4c60-9878-417d07cdfa13]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtvrRIYZ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73cb24c-9961-42a8-b57a-ccf4d720c102]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec75f4c-5ca8-4d6d-9925-c03cefd6f678]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:11 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:11 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:11 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:11 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.198s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] HCTL ('34', '0', '0', 0) found on session 29 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[29703135-0800-460b-88ef-6ff82185c5c3]: (4, ('0 0 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching for a device in session 29 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.230s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '26636646133653963', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636646133653963', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1948242503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1948242503',id=25,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ordclwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:58:38Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=0f4dbd9f-5580-4c29-86b9-cc35d7768715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:0c:d5:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:0c:d5:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:00:11 user nova-compute[70375]:   <uuid>0f4dbd9f-5580-4c29-86b9-cc35d7768715</uuid>
Jul 24 18:00:11 user nova-compute[70375]:   <name>instance-00000019</name>
Jul 24 18:00:11 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:00:11 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:00:11 user nova-compute[70375]:   <metadata>
Jul 24 18:00:11 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:00:11 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1948242503</nova:name>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:00:11</nova:creationTime>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:00:11 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:00:11 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:owner>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 18:00:11 user nova-compute[70375]:       </nova:owner>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:00:11 user nova-compute[70375]:       <nova:ports>
Jul 24 18:00:11 user nova-compute[70375]:         <nova:port uuid="6875b8c9-3b0f-4193-9a70-e68e0f5a8028">
Jul 24 18:00:11 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 18:00:11 user nova-compute[70375]:         </nova:port>
Jul 24 18:00:11 user nova-compute[70375]:       </nova:ports>
Jul 24 18:00:11 user nova-compute[70375]:     </nova:instance>
Jul 24 18:00:11 user nova-compute[70375]:   </metadata>
Jul 24 18:00:11 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:00:11 user nova-compute[70375]:     <system>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="serial">0f4dbd9f-5580-4c29-86b9-cc35d7768715</entry>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="uuid">0f4dbd9f-5580-4c29-86b9-cc35d7768715</entry>
Jul 24 18:00:11 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:00:11 user nova-compute[70375]:     </system>
Jul 24 18:00:11 user nova-compute[70375]:   </sysinfo>
Jul 24 18:00:11 user nova-compute[70375]:   <os>
Jul 24 18:00:11 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:00:11 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:00:11 user nova-compute[70375]:   </os>
Jul 24 18:00:11 user nova-compute[70375]:   <features>
Jul 24 18:00:11 user nova-compute[70375]:     <acpi/>
Jul 24 18:00:11 user nova-compute[70375]:     <apic/>
Jul 24 18:00:11 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:00:11 user nova-compute[70375]:   </features>
Jul 24 18:00:11 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:00:11 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:00:11 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:00:11 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:00:11 user nova-compute[70375]:   </clock>
Jul 24 18:00:11 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:00:11 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:00:11 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:00:11 user nova-compute[70375]:   </cpu>
Jul 24 18:00:11 user nova-compute[70375]:   <devices>
Jul 24 18:00:11 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:00:11 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:11 user nova-compute[70375]:       <source dev="/dev/sdc"/>
Jul 24 18:00:11 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:00:11 user nova-compute[70375]:       <serial>a853cda1-83d4-42f3-bc65-a869f4a12d77</serial>
Jul 24 18:00:11 user nova-compute[70375]:     </disk>
Jul 24 18:00:11 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:00:11 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:00:11 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue"/>
Jul 24 18:00:11 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 18:00:11 user nova-compute[70375]:       <boot order="1"/>
Jul 24 18:00:11 user nova-compute[70375]:     </disk>
Jul 24 18:00:11 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:00:11 user nova-compute[70375]:       <mac address="fa:16:3e:0c:d5:e6"/>
Jul 24 18:00:11 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:00:11 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:00:11 user nova-compute[70375]:       <target dev="tap6875b8c9-3b"/>
Jul 24 18:00:11 user nova-compute[70375]:     </interface>
Jul 24 18:00:11 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:00:11 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/console.log" append="off"/>
Jul 24 18:00:11 user nova-compute[70375]:     </serial>
Jul 24 18:00:11 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:00:11 user nova-compute[70375]:     <video>
Jul 24 18:00:11 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:00:11 user nova-compute[70375]:     </video>
Jul 24 18:00:11 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:00:11 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:00:11 user nova-compute[70375]:     </rng>
Jul 24 18:00:11 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:00:11 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:00:11 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:00:11 user nova-compute[70375]:     </memballoon>
Jul 24 18:00:11 user nova-compute[70375]:   </devices>
Jul 24 18:00:11 user nova-compute[70375]: </domain>
Jul 24 18:00:11 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:00:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance destroyed successfully.
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:0c:d5:e6, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:13 user nova-compute[70375]: WARNING nova.compute.manager [req-0184e3d7-a6da-41bd-bfb0-91c82b7e0140 req-caeab5db-ca7a-41f2-8da0-8e14c1ae7d62 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state rescuing.
Jul 24 18:00:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 0f4dbd9f-5580-4c29-86b9-cc35d7768715 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221615.1232657, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:00:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Resumed (Lifecycle Event)
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a90c9e90-e96d-4055-a6ef-5440db7439df tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:15 user nova-compute[70375]: WARNING nova.compute.manager [req-7a6b7d20-9d07-4595-9e31-61dcac7ee88e req-df921114-b5b6-42d6-9473-8a4183cde93d service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state rescuing.
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:00:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221615.1248531, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:00:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Started (Lifecycle Event)
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:00:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHNzKdgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:18 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:18 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:18 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d88fc-ede6-4b08-bf37-b2d69f187b89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:00:18 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[155cc21b-69d3-41c5-94ab-a5d9baa73619]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472] added
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[655901bd-0eb1-4ef1-b7c2-bb011eb673ab]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba67555-ff66-4cf8-886b-cfe6b25c6acb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHNzKdgD {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHNzKdgD" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4b3fa-7a9a-4e73-b4de-aadb28fe7527]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHNzKdgD'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929c6d5-e497-45f5-9a1f-0817ef13c554]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8529ea-463e-4a58-bbc0-b8297b820077]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f7fd5-7121-4973-be8e-ad8a7c67bcd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260]
Jul 24 18:00:18 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1259ef4-7527-40e8-8156-983637b012a9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[618c15c0-4355-4943-aa83-c2b3abb3f689]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:18 user nova-compute[70375]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)
Jul 24 18:00:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1bb51-567a-461c-a5d6-9f003c76a114]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHNzKdgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23765366566633461', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765366566633461', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:00:19 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:19 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:19 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:19 user nova-compute[70375]:   <serial>90aa8315-6d46-407f-aca6-86f757f06472</serial>
Jul 24 18:00:19 user nova-compute[70375]: </disk>
Jul 24 18:00:19 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] No VIF found with MAC fa:16:3e:f1:f2:cf, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-changed-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Refreshing instance network info cache due to event network-changed-5549309b-3614-4cbc-9881-9fe88f191123. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] Acquiring lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] Acquired lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Refreshing network info cache for port 5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-129bc3b1-1aa9-4359-978a-1319c7e25a8f tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.341s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updated VIF entry in instance network info cache for port 5549309b-3614-4cbc-9881-9fe88f191123. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating instance_info_cache with network_info: [{"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa6e974-a3d8-4d69-8397-517cd697092e req-d230eae3-1297-4a47-9578-7f510137843a service nova] Releasing lock "refresh_cache-ded94bc6-f0cf-47c7-b951-617d636c8121" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:21 user nova-compute[70375]: INFO nova.compute.manager [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Detaching volume 90aa8315-6d46-407f-aca6-86f757f06472
Jul 24 18:00:21 user nova-compute[70375]: INFO nova.virt.block_device [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Attempting to driver detach volume 90aa8315-6d46-407f-aca6-86f757f06472 from mountpoint /dev/vdb
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Attempting to detach device vdb from instance b28f6d6d-768a-4477-b20b-387acd129c18 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:21 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:21 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:21 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:21 user nova-compute[70375]:   <serial>90aa8315-6d46-407f-aca6-86f757f06472</serial>
Jul 24 18:00:21 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:00:21 user nova-compute[70375]: </disk>
Jul 24 18:00:21 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance b28f6d6d-768a-4477-b20b-387acd129c18 from the persistent domain config.
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b28f6d6d-768a-4477-b20b-387acd129c18 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:21 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:21 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:21 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:21 user nova-compute[70375]:   <serial>90aa8315-6d46-407f-aca6-86f757f06472</serial>
Jul 24 18:00:21 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:00:21 user nova-compute[70375]: </disk>
Jul 24 18:00:21 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221621.9591985, b28f6d6d-768a-4477-b20b-387acd129c18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:00:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully detached device vdb from instance b28f6d6d-768a-4477-b20b-387acd129c18 from the live domain config.
Jul 24 18:00:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHNzKdgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:21 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d300efd-b23f-4f66-8c1a-280b057fae0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:00:22 user nova-compute[70375]: No targets found.
Jul 24 18:00:22 user nova-compute[70375]: iSNS:
Jul 24 18:00:22 user nova-compute[70375]: No targets found.
Jul 24 18:00:22 user nova-compute[70375]: STATIC:
Jul 24 18:00:22 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:00:22 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:22 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:22 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:00:22 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:22 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:22 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472
Jul 24 18:00:22 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:22 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:22 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:22 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:22 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:22 user nova-compute[70375]: FIRMWARE:
Jul 24 18:00:22 user nova-compute[70375]: No targets found.
Jul 24 18:00:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:00:22 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:00:22 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5878b02-4541-427c-9a79-5e0183130531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ac158-350e-45b4-8f31-2005be0f27fb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:22 user nova-compute[70375]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 (non-flash)
Jul 24 18:00:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6528ddea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa2b90-ea42-44d7-9046-c8f68ee5234e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f02ab4-fc54-471d-ad07-f063c6eac8b6]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[90017448-01fd-49eb-a70f-c6109f84cb8c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7b0c73-9be2-4709-a8dc-455d9d7fb748]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[de09abf8-faad-4c6d-8f6b-afde3181c76c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3415ae-20ae-446e-ba9e-ebe4b46c6650]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260]
Jul 24 18:00:22 user nova-compute[70375]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90aa8315-6d46-407f-aca6-86f757f06472 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cdf822-49f5-41b8-99c6-4fcfe8b4e385]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] <== disconnect_volume: return (319ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG nova.objects.instance [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:24 user nova-compute[70375]: INFO nova.compute.manager [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attaching volume b2045b92-9d10-4779-b5f0-c60ccd98aed6 to /dev/vdb
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.utils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10e023-b85c-43d7-bc78-d3655c471223]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c943d30-d170-42c8-9f9b-90d0baa8946c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fa00c-6b86-43a8-ad58-6943795ef787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3a415a-0772-4995-afca-89b8f5aa4957]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:24 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7368e4f-c802-47b3-9b3e-ab698d3596ce]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG os_brick.utils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating existing volume attachment record: 645d992f-7bd2-4cb7-9bc7-9797aaec1891 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'flavor' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c193c7b8-2f1b-421a-8966-9c1a52c6bf78 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.323s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [{"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-c97c022f-1bca-4f38-b876-604724ed6442" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG nova.objects.instance [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:30 user nova-compute[70375]: INFO nova.compute.manager [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Attaching volume e0254199-3ea8-4b9e-be2b-94dffbfd7416 to /dev/vdb
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.utils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2117932e-c006-4582-8769-a1cbd2c5e13c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[994878f7-134d-4060-9f14-91b454a32646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e614176-61b8-4bc3-88e8-a1303a2cd8f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[be40729a-f6a4-4a28-a509-9c3b614efb34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:30 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:00:30 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dde7d2-9b61-447a-9be6-1db5c847cb1c]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG os_brick.utils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating existing volume attachment record: 511e5942-08a6-4a83-897d-9b0d8bd6a2f5 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:00:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGOatbeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:33 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:33 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:33 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d95f95-99fc-44b3-8e41-e2a1804e9dcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:00:33 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0fe5bd-937c-4ccd-8850-d43bf64f67ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6] added
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5c6d0-7807-4281-b253-bc7a289eb276]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82907f6-8bc5-4c1a-8b67-2aeb629d6b64]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGOatbeo {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGOatbeo" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6fa73-6455-4ef1-8db0-c1bd73891dde]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WGOatbeo'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4596d353-47bc-4700-9b14-637cdc57d54f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d815dc8-fc55-4000-b293-0d02312e8a2e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3889c-545a-45f0-a005-8566b72be7dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260]
Jul 24 18:00:33 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aec053e-827b-441d-8e11-a806dda78a88]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72fc66-ac1f-4b4f-977b-5e07d6dbed5f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:33 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:33 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d2fa9-5ceb-4b55-a5d3-131b800ea8ff]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:33 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGOatbeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23830616638343165', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830616638343165', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.objects.instance [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:00:34 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:34 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:00:34 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:34 user nova-compute[70375]:   <serial>b2045b92-9d10-4779-b5f0-c60ccd98aed6</serial>
Jul 24 18:00:34 user nova-compute[70375]: </disk>
Jul 24 18:00:34 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No VIF found with MAC fa:16:3e:8d:cb:76, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-72afebeb-080d-446c-9cbc-bea2e78fbad9 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.600s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:00:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7160MB free_disk=24.124412536621094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c97c022f-1bca-4f38-b876-604724ed6442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b28f6d6d-768a-4477-b20b-387acd129c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ded94bc6-f0cf-47c7-b951-617d636c8121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d8a8c993-c271-42b4-9c7a-111a23961f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:41 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:41 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:41 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423ca3e-956f-412a-bbee-282534fb23ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:00:41 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e19ef8-f1e8-4025-b386-ecbb3f1d9adf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416] added
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b7bf9d-8b22-48ae-b51e-65e287799abb]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1791051b-1875-4b11-ae5c-0599d2cf7e36]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCEVuAUe {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCEVuAUe" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcae30c-f22b-44f6-a3ad-8a29e853e45d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCEVuAUe'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8fa176-9458-439d-9a2f-ac95e863802c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5cdd6-516c-425c-b655-b5219902a39f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75236ee-3345-47e3-8b13-7f463542b1da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]
Jul 24 18:00:41 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3c16b-269e-467c-9888-f2b97613fc54]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2ba387-3856-481e-aca8-aca8590a8e54]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce08c9-fb41-4044-a227-3f7612b13773]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:42 user nova-compute[70375]: INFO nova.compute.manager [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attaching volume f1b54b9d-5b6f-468f-8196-d4b59d96bf3d to /dev/vdc
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44f619-fc2d-402f-8316-3a2a7821890a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f578049-8195-4333-8ee2-0cb010b0e493]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7b360-9c08-4b51-8e21-2fdda1056083]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[482989fd-d4d5-44c5-9f2d-be0dc44f4e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:00:42 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:00:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8134dd-185c-4551-b31e-9677920025b4]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating existing volume attachment record: 3f0c6f98-4ef2-4d06-99ae-0a23250b80fe {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23831616630663665', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831616630663665', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:00:42 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:42 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 18:00:42 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:00:42 user nova-compute[70375]:   <serial>e0254199-3ea8-4b9e-be2b-94dffbfd7416</serial>
Jul 24 18:00:42 user nova-compute[70375]: </disk>
Jul 24 18:00:42 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:00:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No VIF found with MAC fa:16:3e:32:50:6c, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54f05fab-dd89-4b29-a1c2-baa24d872ca5 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.787s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-changed-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Refreshing instance network info cache due to event network-changed-ebd5e8e5-a090-4885-a9da-91f048168fde. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] Acquiring lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] Acquired lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:50 user nova-compute[70375]: DEBUG nova.network.neutron [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Refreshing network info cache for port ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:00:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updated VIF entry in instance network info cache for port ebd5e8e5-a090-4885-a9da-91f048168fde. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:00:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating instance_info_cache with network_info: [{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c350dc3b-ade3-4298-aed0-4e665402081e req-8adb1b17-c970-4537-a8c5-4d14807490c2 service nova] Releasing lock "refresh_cache-d8a8c993-c271-42b4-9c7a-111a23961f19" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aszPHqSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:52 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:52 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:52 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b518505-d0a6-45bd-ba76-1e25e44f045e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:00:52 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f5d3b-80f8-432d-b2dd-3feca9204c45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d] added
Jul 24 18:00:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f90791-b8a6-48d9-a509-b6121389b0cf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc405e-a0a3-4e1f-8a96-c5b20a32e12c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aszPHqSw {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aszPHqSw" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[23064349-e94e-4db6-bc95-eff892d185ba]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aszPHqSw'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa3bf24-7822-48a1-82d9-c3f1cc7becb1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d2df85-9b27-4699-96b9-46bc73f73cb5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: INFO nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Rebuilding instance
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e487f64-9d40-4d49-826b-cfd5a92830d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260]
Jul 24 18:00:53 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5774d1-54a4-4bbb-9c49-eba0a837861e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada86bf-9b62-40ef-97d0-600acbe90bba]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:53 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:53 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'pci_requests' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b6e9c-5daa-4054-b074-a8b6ef5ba4be]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aszPHqSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'pci_devices' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'resources' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'migration_context' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70375) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:53 user nova-compute[70375]: WARNING nova.compute.manager [req-1649ffbc-6693-425d-96f3-fea1ce4e5647 req-edceddc7-3049-44fd-a55a-26fd332cfbc0 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state active and task_state rebuilding.
Jul 24 18:00:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance destroyed successfully.
Jul 24 18:00:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance destroyed successfully.
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1462534967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd5e8e5-a0, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:00:54 user nova-compute[70375]: INFO os_vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0')
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:54 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23431616461353233', 'path': '/dev/sdg'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431616461353233', 'path': '/dev/sdg'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.181s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94de720f-c02f-492e-b494-a747bae1b4a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]: iSNS:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]: STATIC:
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: FIRMWARE:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:00:54 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:00:54 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:00:54 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:54 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 18:00:54 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:00:54 user nova-compute[70375]:   <serial>f1b54b9d-5b6f-468f-8196-d4b59d96bf3d</serial>
Jul 24 18:00:54 user nova-compute[70375]: </disk>
Jul 24 18:00:54 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101ef4b-6c83-4382-9b5d-faf66168b4a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a275e8-adad-4076-9817-4b6ce15a3c1b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe65128d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a75e0-4272-48e5-a76b-4f4dec5b3b38]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd1f4e4-c050-48c8-b65b-ed7d60528670]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a323bff9-0788-4139-ba75-ec057d04adfa]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db74063c-369d-4872-9003-bbfbc93745fe]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e00225-d7fc-413c-91d2-a203759a960e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ec18d-2895-47cf-8d2b-a61aabaf37dd]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]
Jul 24 18:00:54 user nova-compute[70375]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[06228160-d683-4945-8588-e76abe9ee4cc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== disconnect_volume: return (533ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:00:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deleting instance files /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19_del
Jul 24 18:00:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deletion of /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19_del complete
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] No VIF found with MAC fa:16:3e:8d:cb:76, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:00:54 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d8a8c993-c271-42b4-9c7a-111a23961f19 could not be found.
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:54 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1e2b041a-f042-4db6-9407-acc05f6183f0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.842s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7f576-ae80-451e-a680-1f9d83310164]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]: iSNS:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]: STATIC:
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:54 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:54 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:54 user nova-compute[70375]: FIRMWARE:
Jul 24 18:00:54 user nova-compute[70375]: No targets found.
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:00:54 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:00:54 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27197a-5c5a-4fb9-977e-1c9ad66c33de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d7009-0c02-43d2-99b0-acba5e00626d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:54 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:54 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe656aae3b0>, {}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Disconnecting from: [] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== disconnect_volume: return (82ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:00:55 user nova-compute[70375]: WARNING nova.compute.manager [req-d69a17ea-3f16-405e-a703-e76cdc5dfc93 req-aae7343a-6165-47ab-a10f-c294550d0eca service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state active and task_state rebuilding.
Jul 24 18:00:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Preparing to wait for external event volume-reimaged-9e28b1f5-6ef3-4050-897d-ab56781c4efe {{(pid=70375) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:00:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:00:56 user nova-compute[70375]: INFO nova.compute.manager [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Detaching volume f1b54b9d-5b6f-468f-8196-d4b59d96bf3d
Jul 24 18:00:56 user nova-compute[70375]: INFO nova.virt.block_device [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attempting to driver detach volume f1b54b9d-5b6f-468f-8196-d4b59d96bf3d from mountpoint /dev/vdc
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Attempting to detach device vdc from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:56 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:56 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 18:00:56 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:00:56 user nova-compute[70375]:   <serial>f1b54b9d-5b6f-468f-8196-d4b59d96bf3d</serial>
Jul 24 18:00:56 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 18:00:56 user nova-compute[70375]: </disk>
Jul 24 18:00:56 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully detached device vdc from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the persistent domain config.
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:00:56 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:00:56 user nova-compute[70375]:   <source dev="/dev/sdg"/>
Jul 24 18:00:56 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:00:56 user nova-compute[70375]:   <serial>f1b54b9d-5b6f-468f-8196-d4b59d96bf3d</serial>
Jul 24 18:00:56 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 18:00:56 user nova-compute[70375]: </disk>
Jul 24 18:00:56 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-changed-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing instance network info cache due to event network-changed-216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221656.803267, ded94bc6-f0cf-47c7-b951-617d636c8121 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:00:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully detached device vdc from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the live domain config.
Jul 24 18:00:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aszPHqSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:00:56 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c57acca-9b68-4200-b2bd-e3138c0aa0f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:00:56 user nova-compute[70375]: No targets found.
Jul 24 18:00:56 user nova-compute[70375]: iSNS:
Jul 24 18:00:56 user nova-compute[70375]: No targets found.
Jul 24 18:00:56 user nova-compute[70375]: STATIC:
Jul 24 18:00:56 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:00:56 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:56 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:56 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:00:56 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:56 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:56 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:00:56 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:56 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:56 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d
Jul 24 18:00:56 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:56 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:56 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:00:56 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:00:56 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:00:56 user nova-compute[70375]: FIRMWARE:
Jul 24 18:00:56 user nova-compute[70375]: No targets found.
Jul 24 18:00:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:00:56 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:00:56 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1346cae-0642-4fda-bfad-c8e95b9774fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46ea10-290b-4c95-baf7-60a3b7e3a236]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:00:56 user nova-compute[70375]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d (non-flash)
Jul 24 18:00:56 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483a6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d'): ({'sdg'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Removing single pathed devices sdg {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2a9ba-89c2-49a1-96de-e86308793778]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b448d6-b433-48df-a626-283ed0a59d82]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Flushing IO for device /dev/sdg {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6125313-cd1d-4607-beb5-59bd4b57a396]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:00:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a06868-aa4b-4907-982b-b655a598e9cc]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updated VIF entry in instance network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1adab3-e17e-41c4-b3ac-44eff77e06b9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dc59335a-b0c7-41ec-bf03-f0f5cdfd83c2 req-ef09e1cb-152f-4eb5-bbdb-672268e87b6e service nova] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22a898-fac5-4bfe-a0c3-4aec3f9223ea]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260]
Jul 24 18:00:57 user nova-compute[70375]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d, portal: 172.16.0.220,3260] successful.
Jul 24 18:00:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b54b9d-5b6f-468f-8196-d4b59d96bf3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e2e2d-b013-4273-997e-e268efa8b908]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== disconnect_volume: return (338ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:00:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-changed-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:00:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing instance network info cache due to event network-changed-216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:00:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:00:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:00:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:00:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:00:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updated VIF entry in instance network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:00:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:00:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bad4229-dea4-498c-8244-6700a319f2cc req-f5848fcc-e444-44ed-9733-9bf18a00d3f3 service nova] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4063e020-c429-42bb-9509-f3e97aef6134 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.301s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:03 user nova-compute[70375]: INFO nova.compute.manager [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Rebooting instance
Jul 24 18:01:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:01:04 user nova-compute[70375]: INFO nova.compute.claims [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Claim successful on node user
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:01:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:04 user nova-compute[70375]: WARNING nova.compute.manager [req-3b29ef59-40b1-4662-b5d9-fc38b0b3c2c6 req-87f8d5da-e3a7-4c8e-bd2e-3329f9413f96 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 18:01:04 user nova-compute[70375]: INFO nova.virt.block_device [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Booting with volume 58e4e392-68f3-4083-8350-1fb33054bf5b at /dev/vda
Jul 24 18:01:04 user nova-compute[70375]: DEBUG nova.policy [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa75ae32ac1049f794ce2f8433df6529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07a82b57ae84e8892d950cdc0d7507b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG os_brick.utils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd806e12-c11e-424f-82c9-7a4171273a16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cf0f71-d2ab-4041-8649-7e0312ea1a55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016f265-b5ca-44ed-82f0-9864fdb43e27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec404fe-1283-43a0-85ba-9d6e609bfd28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:01:05 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6591198-65ac-45be-9a81-52ca9e602ead]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.utils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating existing volume attachment record: 2c4e5a44-f9c1-456d-a404-ba4a47702661 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:01:05 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance destroyed successfully.
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'resources' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:01:04Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap216d7d69-34, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:05 user nova-compute[70375]: INFO os_vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34')
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:05 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e702e5b-f1b6-4282-93a0-f437694b4a2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:01:05 user nova-compute[70375]: No targets found.
Jul 24 18:01:05 user nova-compute[70375]: iSNS:
Jul 24 18:01:05 user nova-compute[70375]: No targets found.
Jul 24 18:01:05 user nova-compute[70375]: STATIC:
Jul 24 18:01:05 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:01:05 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:05 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:05 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:01:05 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:05 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:05 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:01:05 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:05 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:05 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:01:05 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:05 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:05 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:01:05 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:05 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:05 user nova-compute[70375]: FIRMWARE:
Jul 24 18:01:05 user nova-compute[70375]: No targets found.
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:01:05 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:01:05 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec7806-4847-467b-bdea-5ae270e05135]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc055aa4-9cb5-467f-8c12-26683319daee]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe656aae8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee791f-1e0f-4d72-8251-185f385ece64]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca4874-0849-4789-92d0-de9c7c03a4eb]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66336bb4-2c80-48d2-add7-3c31faa69ccc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c12975c-df59-4fae-82cf-c2ccbfa1e152]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9271c0ad-b255-4634-8356-7eca65b23e63]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Successfully created port: 9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8680ed-2571-4b06-8da7-30011ef5f2a3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]
Jul 24 18:01:05 user nova-compute[70375]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a63fc-983a-441a-9d12-37c2fbf4dcec]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== disconnect_volume: return (340ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start _get_guest_xml network_info=[{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=591c5d22-0f80-4b31-8e49-d57afcd9b746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '591c5d22-0f80-4b31-8e49-d57afcd9b746'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '511e5942-08a6-4a83-897d-9b0d8bd6a2f5', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '55e5e70a-02e5-4363-89b3-02cef5942015', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'serial': 'e0254199-3ea8-4b9e-be2b-94dffbfd7416'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:01:05 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:05 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=591c5d22-0f80-4b31-8e49-d57afcd9b746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:05 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:05 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:05 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c78f78-4633-44b8-ae3f-4d57c54c3a8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:01:05 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6506fb-08d3-4c56-8c49-5cdc325cdd35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416] added
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a5a09-bf18-43ef-841c-951428b5d0ff]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d67e15b-3aed-40ab-a54b-daac0eb2e58c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCEVuAUe {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCEVuAUe" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f6613-bf8e-4ce6-8983-d7dc774b1c31]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCEVuAUe'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[85094793-31bc-479e-8b1b-cfd55d0309aa]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db468e-0e20-4958-a911-453f3e1524ca]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:05 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4de939-41ba-49bd-87f7-bd4eb8fc6003]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]
Jul 24 18:01:06 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d0271d-a77f-4342-956d-7812227e2265]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b6b7bf-5f7c-469c-9f15-d6e3ba2181a0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:06 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ef7c8-36ef-45da-bfb8-f9dfd7e6db75]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Successfully updated port: 9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-changed-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Refreshing instance network info cache due to event network-changed-9adfd0ef-ef85-4592-be45-816bdf90235d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:06 user nova-compute[70375]: WARNING nova.compute.manager [req-e714d088-ce43-48c4-be49-e562afe01eba req-656ede62-d1c4-4531-ab87-429f47308b29 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance network_info: |[{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Refreshing network info cache for port 9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23831616630663665', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831616630663665', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:01:04Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'pci_devices' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:01:07 user nova-compute[70375]:   <uuid>55e5e70a-02e5-4363-89b3-02cef5942015</uuid>
Jul 24 18:01:07 user nova-compute[70375]:   <name>instance-0000001b</name>
Jul 24 18:01:07 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:01:07 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:01:07 user nova-compute[70375]:   <metadata>
Jul 24 18:01:07 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:01:07 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:name>tempest-TestMinimumBasicScenario-server-737970939</nova:name>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:01:05</nova:creationTime>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:01:07 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:01:07 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:owner>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:user uuid="2c5063436895467ca5ffae12856a1677">tempest-TestMinimumBasicScenario-1073066154-project-member</nova:user>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:project uuid="a342f080683d45b29897f8bf407de037">tempest-TestMinimumBasicScenario-1073066154</nova:project>
Jul 24 18:01:07 user nova-compute[70375]:       </nova:owner>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:root type="image" uuid="591c5d22-0f80-4b31-8e49-d57afcd9b746"/>
Jul 24 18:01:07 user nova-compute[70375]:       <nova:ports>
Jul 24 18:01:07 user nova-compute[70375]:         <nova:port uuid="216d7d69-3422-4e84-8525-4494e06baa85">
Jul 24 18:01:07 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 18:01:07 user nova-compute[70375]:         </nova:port>
Jul 24 18:01:07 user nova-compute[70375]:       </nova:ports>
Jul 24 18:01:07 user nova-compute[70375]:     </nova:instance>
Jul 24 18:01:07 user nova-compute[70375]:   </metadata>
Jul 24 18:01:07 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:01:07 user nova-compute[70375]:     <system>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="serial">55e5e70a-02e5-4363-89b3-02cef5942015</entry>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="uuid">55e5e70a-02e5-4363-89b3-02cef5942015</entry>
Jul 24 18:01:07 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:01:07 user nova-compute[70375]:     </system>
Jul 24 18:01:07 user nova-compute[70375]:   </sysinfo>
Jul 24 18:01:07 user nova-compute[70375]:   <os>
Jul 24 18:01:07 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:01:07 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:01:07 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:01:07 user nova-compute[70375]:   </os>
Jul 24 18:01:07 user nova-compute[70375]:   <features>
Jul 24 18:01:07 user nova-compute[70375]:     <acpi/>
Jul 24 18:01:07 user nova-compute[70375]:     <apic/>
Jul 24 18:01:07 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:01:07 user nova-compute[70375]:   </features>
Jul 24 18:01:07 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:01:07 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:01:07 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:01:07 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:01:07 user nova-compute[70375]:   </clock>
Jul 24 18:01:07 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:01:07 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:01:07 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:01:07 user nova-compute[70375]:   </cpu>
Jul 24 18:01:07 user nova-compute[70375]:   <devices>
Jul 24 18:01:07 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:01:07 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:01:07 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk"/>
Jul 24 18:01:07 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:01:07 user nova-compute[70375]:     </disk>
Jul 24 18:01:07 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:01:07 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:07 user nova-compute[70375]:       <source dev="/dev/sdf"/>
Jul 24 18:01:07 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 18:01:07 user nova-compute[70375]:       <serial>e0254199-3ea8-4b9e-be2b-94dffbfd7416</serial>
Jul 24 18:01:07 user nova-compute[70375]:     </disk>
Jul 24 18:01:07 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:01:07 user nova-compute[70375]:       <mac address="fa:16:3e:32:50:6c"/>
Jul 24 18:01:07 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:07 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:01:07 user nova-compute[70375]:       <target dev="tap216d7d69-34"/>
Jul 24 18:01:07 user nova-compute[70375]:     </interface>
Jul 24 18:01:07 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:01:07 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/console.log" append="off"/>
Jul 24 18:01:07 user nova-compute[70375]:     </serial>
Jul 24 18:01:07 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:01:07 user nova-compute[70375]:     <video>
Jul 24 18:01:07 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:07 user nova-compute[70375]:     </video>
Jul 24 18:01:07 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:01:07 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:01:07 user nova-compute[70375]:     </rng>
Jul 24 18:01:07 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:01:07 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:01:07 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:01:07 user nova-compute[70375]:     </memballoon>
Jul 24 18:01:07 user nova-compute[70375]:   </devices>
Jul 24 18:01:07 user nova-compute[70375]: </domain>
Jul 24 18:01:07 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updated VIF entry in instance network info cache for port 9adfd0ef-ef85-4592-be45-816bdf90235d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ec2aaf57-06e1-403f-8762-5826b459783f req-0d9ccc4f-fcd5-4ee9-b410-49bf24fc48b1 service nova] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Cannot resize image /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'migration_context' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:01:04Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG os_vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap216d7d69-34, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap216d7d69-34, col_values=(('external_ids', {'iface-id': '216d7d69-3422-4e84-8525-4494e06baa85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:50:6c', 'vm-uuid': '55e5e70a-02e5-4363-89b3-02cef5942015'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:07 user nova-compute[70375]: INFO os_vif [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34')
Jul 24 18:01:09 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221654.0174522, d8a8c993-c271-42b4-9c7a-111a23961f19 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:09 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Stopped (Lifecycle Event)
Jul 24 18:01:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6e9b2019-51d0-496d-b038-d6c2b23643ac None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:09 user nova-compute[70375]: WARNING nova.compute.manager [req-11d5d7db-9f0e-448f-958e-0a85b25e71f1 req-47f54ded-c5d5-4c22-87b2-41840b85733a service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 55e5e70a-02e5-4363-89b3-02cef5942015 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221671.4715211, 55e5e70a-02e5-4363-89b3-02cef5942015 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] VM Resumed (Lifecycle Event)
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:01:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance rebooted successfully.
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221671.4739022, 55e5e70a-02e5-4363-89b3-02cef5942015 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] VM Started (Lifecycle Event)
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ee214428-3d2d-4c7d-a25d-ff2c435cada0 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.729s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:11 user nova-compute[70375]: WARNING nova.compute.manager [req-ab3b0f17-f0db-4a93-8d17-ff1d4c120be7 req-4e5e389a-cb39-4b6e-be2f-0447766fa6fc service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state active and task_state None.
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:11 user nova-compute[70375]: INFO nova.compute.manager [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Terminating instance
Jul 24 18:01:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-23319859-e458-464f-a5d3-3b2f9835c775 req-081e385d-7556-4e5b-88a3-9b624d3c0983 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event volume-reimaged-9e28b1f5-6ef3-4050-897d-ab56781c4efe {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-23319859-e458-464f-a5d3-3b2f9835c775 req-081e385d-7556-4e5b-88a3-9b624d3c0983 service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-23319859-e458-464f-a5d3-3b2f9835c775 req-081e385d-7556-4e5b-88a3-9b624d3c0983 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-23319859-e458-464f-a5d3-3b2f9835c775 req-081e385d-7556-4e5b-88a3-9b624d3c0983 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-23319859-e458-464f-a5d3-3b2f9835c775 req-081e385d-7556-4e5b-88a3-9b624d3c0983 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Processing event volume-reimaged-9e28b1f5-6ef3-4050-897d-ab56781c4efe {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:01:12 user nova-compute[70375]: INFO nova.virt.block_device [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Booting with volume 9e28b1f5-6ef3-4050-897d-ab56781c4efe at /dev/vda
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.utils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c19646-fbaa-410a-84af-a7e7d754cb9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec1bc7-f498-4890-b0bd-7bff97c2e980]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5a3c5-6803-41a8-906e-035df261f941]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170d807-9147-4e60-88e5-f7b9d79e91c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:01:12 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d908bb-05d4-4d25-a8a4-7d0964c4c68c]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_brick.utils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating existing volume attachment record: cd20ac73-fa45-4f90-8d61-d5eb88b40d54 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:01:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Instance destroyed successfully.
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lazy-loading 'resources' on Instance uuid b28f6d6d-768a-4477-b20b-387acd129c18 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576968025',display_name='tempest-AttachVolumeNegativeTest-server-1576968025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576968025',id=24,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrwyruz5xqLrXeMUNJbIA1fsK8cPgvRNJgGGwavBeL1HcBfN0Shv6ezUTaCGWkI4Qp0ti5U5p2WqQloaDtKqXu+5JsOPVqx+N9KwJvCqxuGgHPn83PUC8Z5SD9lxWrGLg==',key_name='tempest-keypair-1240096683',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ce4fa18b04c41078f64aa0af0777e51',ramdisk_id='',reservation_id='r-0u4ato4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-777978815',owner_user_name='tempest-AttachVolumeNegativeTest-777978815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edc5d742d0f4dc3ba67f1fad87937ac',uuid=b28f6d6d-768a-4477-b20b-387acd129c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converting VIF {"id": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "address": "fa:16:3e:f1:f2:cf", "network": {"id": "a5654add-74f6-4fe9-9a0d-541055c430ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1417979795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ce4fa18b04c41078f64aa0af0777e51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99cf6db3-1b", "ovs_interfaceid": "99cf6db3-1b2e-4e4f-829c-c76ff3cd344c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG os_vif [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99cf6db3-1b, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:12 user nova-compute[70375]: INFO os_vif [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f2:cf,bridge_name='br-int',has_traffic_filtering=True,id=99cf6db3-1b2e-4e4f-829c-c76ff3cd344c,network=Network(a5654add-74f6-4fe9-9a0d-541055c430ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99cf6db3-1b')
Jul 24 18:01:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Deleting instance files /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18_del
Jul 24 18:01:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Deletion of /opt/stack/data/nova/instances/b28f6d6d-768a-4477-b20b-387acd129c18_del complete
Jul 24 18:01:12 user nova-compute[70375]: INFO nova.compute.manager [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 24 18:01:12 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:01:12 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:01:13 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Creating image(s)
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Ensure instance console log exists: /opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start _get_guest_xml network_info=[{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c4e5a44-f9c1-456d-a404-ba4a47702661', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fec2e88-1d18-4b2b-b8e4-b03d39c9646f', 'attached_at': '', 'detached_at': '', 'volume_id': '58e4e392-68f3-4083-8350-1fb33054bf5b', 'serial': '58e4e392-68f3-4083-8350-1fb33054bf5b'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:01:13 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:13 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:13 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:13 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:13 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bd24c0-3c95-4f39-8126-f6ee47469cb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:01:13 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3dbb7-5558-4d3a-a237-b51ae13fab71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b] added
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8023a-eb7e-403c-9907-4c22fc36cd78]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08415bc-3840-4a11-be60-eb3a1d4cf137]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrFhECZA {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrFhECZA" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4245134-e6a3-4bd9-8bab-d718e57acccf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrFhECZA'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f60295-63c2-48b0-89ac-265406cacc09]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeafd30-5b2d-450b-95b3-3bbdba5f5ea9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10c765-6bbd-4fce-83fe-e23ba37d9f66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]
Jul 24 18:01:13 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2853e8bb-09f1-47e4-bf2f-a37cea1cd771]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[444b5a75-160d-4ab7-8b59-b520d0135291]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:13 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:13 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c61cee-048e-49ac-9316-9177ce87930c]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-unplugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] No waiting events found dispatching network-vif-unplugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-unplugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Acquiring lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] Lock "b28f6d6d-768a-4477-b20b-387acd129c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] No waiting events found dispatching network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:13 user nova-compute[70375]: WARNING nova.compute.manager [req-451fbe73-691f-4897-a941-91f46dca14c1 req-07f97b21-a79d-4581-97bb-6c340d74fe2d service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received unexpected event network-vif-plugged-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c for instance with vm_state active and task_state deleting.
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:13 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Took 1.00 seconds to deallocate network for instance.
Jul 24 18:01:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-84daaee3-f7e4-4958-9e60-2090196d9a78 req-fd92a963-9cc2-42a1-b777-e46a09c7ecc4 service nova] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Received event network-vif-deleted-99cf6db3-1b2e-4e4f-829c-c76ff3cd344c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:14 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Deleted allocations for instance b28f6d6d-768a-4477-b20b-387acd129c18
Jul 24 18:01:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3a2e23e2-387b-4e9c-8a63-1a93a9a43dc5 tempest-AttachVolumeNegativeTest-777978815 tempest-AttachVolumeNegativeTest-777978815-project-member] Lock "b28f6d6d-768a-4477-b20b-387acd129c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23262666661323337', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666661323337', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:01:14 user nova-compute[70375]:   <uuid>8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</uuid>
Jul 24 18:01:14 user nova-compute[70375]:   <name>instance-0000001d</name>
Jul 24 18:01:14 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:01:14 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:01:14 user nova-compute[70375]:   <metadata>
Jul 24 18:01:14 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:01:14 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:01:14 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherA-server-1833106531</nova:name>
Jul 24 18:01:14 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:01:13</nova:creationTime>
Jul 24 18:01:14 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:01:14 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:01:14 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:01:14 user nova-compute[70375]:       <nova:owner>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:user uuid="aa75ae32ac1049f794ce2f8433df6529">tempest-ServerActionsTestOtherA-528723047-project-member</nova:user>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:project uuid="d07a82b57ae84e8892d950cdc0d7507b">tempest-ServerActionsTestOtherA-528723047</nova:project>
Jul 24 18:01:14 user nova-compute[70375]:       </nova:owner>
Jul 24 18:01:14 user nova-compute[70375]:       <nova:ports>
Jul 24 18:01:14 user nova-compute[70375]:         <nova:port uuid="9adfd0ef-ef85-4592-be45-816bdf90235d">
Jul 24 18:01:14 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 18:01:14 user nova-compute[70375]:         </nova:port>
Jul 24 18:01:14 user nova-compute[70375]:       </nova:ports>
Jul 24 18:01:14 user nova-compute[70375]:     </nova:instance>
Jul 24 18:01:14 user nova-compute[70375]:   </metadata>
Jul 24 18:01:14 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:01:14 user nova-compute[70375]:     <system>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="serial">8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</entry>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="uuid">8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</entry>
Jul 24 18:01:14 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:01:14 user nova-compute[70375]:     </system>
Jul 24 18:01:14 user nova-compute[70375]:   </sysinfo>
Jul 24 18:01:14 user nova-compute[70375]:   <os>
Jul 24 18:01:14 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:01:14 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:01:14 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:01:14 user nova-compute[70375]:   </os>
Jul 24 18:01:14 user nova-compute[70375]:   <features>
Jul 24 18:01:14 user nova-compute[70375]:     <acpi/>
Jul 24 18:01:14 user nova-compute[70375]:     <apic/>
Jul 24 18:01:14 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:01:14 user nova-compute[70375]:   </features>
Jul 24 18:01:14 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:01:14 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:01:14 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:01:14 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:01:14 user nova-compute[70375]:   </clock>
Jul 24 18:01:14 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:01:14 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:01:14 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:01:14 user nova-compute[70375]:   </cpu>
Jul 24 18:01:14 user nova-compute[70375]:   <devices>
Jul 24 18:01:14 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:01:14 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:14 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 18:01:14 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:01:14 user nova-compute[70375]:       <serial>58e4e392-68f3-4083-8350-1fb33054bf5b</serial>
Jul 24 18:01:14 user nova-compute[70375]:     </disk>
Jul 24 18:01:14 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:01:14 user nova-compute[70375]:       <mac address="fa:16:3e:f7:0f:1a"/>
Jul 24 18:01:14 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:14 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:01:14 user nova-compute[70375]:       <target dev="tap9adfd0ef-ef"/>
Jul 24 18:01:14 user nova-compute[70375]:     </interface>
Jul 24 18:01:14 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:01:14 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f/console.log" append="off"/>
Jul 24 18:01:14 user nova-compute[70375]:     </serial>
Jul 24 18:01:14 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:01:14 user nova-compute[70375]:     <video>
Jul 24 18:01:14 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:14 user nova-compute[70375]:     </video>
Jul 24 18:01:14 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:01:14 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:01:14 user nova-compute[70375]:     </rng>
Jul 24 18:01:14 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:01:14 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:01:14 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:01:14 user nova-compute[70375]:     </memballoon>
Jul 24 18:01:14 user nova-compute[70375]:   </devices>
Jul 24 18:01:14 user nova-compute[70375]: </domain>
Jul 24 18:01:14 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG os_vif [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9adfd0ef-ef, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9adfd0ef-ef, col_values=(('external_ids', {'iface-id': '9adfd0ef-ef85-4592-be45-816bdf90235d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:0f:1a', 'vm-uuid': '8fec2e88-1d18-4b2b-b8e4-b03d39c9646f'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:14 user nova-compute[70375]: INFO os_vif [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef')
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:01:14 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No VIF found with MAC fa:16:3e:f7:0f:1a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:01:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:16 user nova-compute[70375]: WARNING nova.compute.manager [req-d08ac7d1-c291-4f0c-b460-769e71d9da8c req-045180e5-d39d-49cd-acf3-fb280adbaadb service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state building and task_state spawning.
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:18 user nova-compute[70375]: WARNING nova.compute.manager [req-894c3e62-65b4-459b-9c7b-293afe576798 req-2e714a9e-9f34-49c4-a25a-d24446e73613 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state building and task_state spawning.
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221678.5066466, 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] VM Resumed (Lifecycle Event)
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance spawned successfully.
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221678.5083976, 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] VM Started (Lifecycle Event)
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Took 5.44 seconds to spawn the instance on the hypervisor.
Jul 24 18:01:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:18 user nova-compute[70375]: INFO nova.compute.manager [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Took 14.55 seconds to build instance.
Jul 24 18:01:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ec3054f8-29a0-4ea7-a2c2-bf1b30a2f3a7 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.646s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:01:20 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Creating image(s)
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Ensure instance console log exists: /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start _get_guest_xml network_info=[{"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cd20ac73-fa45-4f90-8d61-d5eb88b40d54', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8a8c993-c271-42b4-9c7a-111a23961f19', 'attached_at': '', 'detached_at': '', 'volume_id': '9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'serial': '9e28b1f5-6ef3-4050-897d-ab56781c4efe'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:01:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 18:01:20 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:20 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:20 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:20 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f771b9a0-3241-4733-a065-69874d0066f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:01:20 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7a88c-30b1-4d5b-9c11-452507a23b38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe] added
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe9be3-f6af-4c12-bc6a-d97303334700]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f112b3c-4525-404d-9564-8ac57818607f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcdhHNOl {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcdhHNOl" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cec7d9-8464-44e7-aa14-c48c8ac93cf5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcdhHNOl'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b157c4-9a48-466f-98ac-20ca67cb020a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[90097b28-0da9-4190-8624-fd5a27cf3231]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d38e2-482d-4989-8491-d1b477b5d401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]
Jul 24 18:01:20 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8f37b-b962-4b5f-aac0-4fd46d78e9f6]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a631b-7f76-4388-aeff-9e9f51c9ce7c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:20 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:20 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[692eb8a9-7924-40bb-9746-37c24b599950]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:20 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:01:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23065633165613530', 'path': '/dev/sdg'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633165613530', 'path': '/dev/sdg'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1462534967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:01:22 user nova-compute[70375]:   <uuid>d8a8c993-c271-42b4-9c7a-111a23961f19</uuid>
Jul 24 18:01:22 user nova-compute[70375]:   <name>instance-0000001c</name>
Jul 24 18:01:22 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:01:22 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:01:22 user nova-compute[70375]:   <metadata>
Jul 24 18:01:22 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:01:22 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:01:22 user nova-compute[70375]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1462534967</nova:name>
Jul 24 18:01:22 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:01:20</nova:creationTime>
Jul 24 18:01:22 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:01:22 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:01:22 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:01:22 user nova-compute[70375]:       <nova:owner>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:user uuid="1395e4ee5bd4408783d423729093834d">tempest-ServerActionsV293TestJSON-1282122326-project-member</nova:user>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:project uuid="aa85032ee2074843ab0c0a4d27947eda">tempest-ServerActionsV293TestJSON-1282122326</nova:project>
Jul 24 18:01:22 user nova-compute[70375]:       </nova:owner>
Jul 24 18:01:22 user nova-compute[70375]:       <nova:ports>
Jul 24 18:01:22 user nova-compute[70375]:         <nova:port uuid="ebd5e8e5-a090-4885-a9da-91f048168fde">
Jul 24 18:01:22 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 18:01:22 user nova-compute[70375]:         </nova:port>
Jul 24 18:01:22 user nova-compute[70375]:       </nova:ports>
Jul 24 18:01:22 user nova-compute[70375]:     </nova:instance>
Jul 24 18:01:22 user nova-compute[70375]:   </metadata>
Jul 24 18:01:22 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:01:22 user nova-compute[70375]:     <system>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="serial">d8a8c993-c271-42b4-9c7a-111a23961f19</entry>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="uuid">d8a8c993-c271-42b4-9c7a-111a23961f19</entry>
Jul 24 18:01:22 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:01:22 user nova-compute[70375]:     </system>
Jul 24 18:01:22 user nova-compute[70375]:   </sysinfo>
Jul 24 18:01:22 user nova-compute[70375]:   <os>
Jul 24 18:01:22 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:01:22 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:01:22 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:01:22 user nova-compute[70375]:   </os>
Jul 24 18:01:22 user nova-compute[70375]:   <features>
Jul 24 18:01:22 user nova-compute[70375]:     <acpi/>
Jul 24 18:01:22 user nova-compute[70375]:     <apic/>
Jul 24 18:01:22 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:01:22 user nova-compute[70375]:   </features>
Jul 24 18:01:22 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:01:22 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:01:22 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:01:22 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:01:22 user nova-compute[70375]:   </clock>
Jul 24 18:01:22 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:01:22 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:01:22 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:01:22 user nova-compute[70375]:   </cpu>
Jul 24 18:01:22 user nova-compute[70375]:   <devices>
Jul 24 18:01:22 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:01:22 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:22 user nova-compute[70375]:       <source dev="/dev/sdg"/>
Jul 24 18:01:22 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:01:22 user nova-compute[70375]:       <serial>9e28b1f5-6ef3-4050-897d-ab56781c4efe</serial>
Jul 24 18:01:22 user nova-compute[70375]:     </disk>
Jul 24 18:01:22 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:01:22 user nova-compute[70375]:       <mac address="fa:16:3e:6c:8e:92"/>
Jul 24 18:01:22 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:22 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:01:22 user nova-compute[70375]:       <target dev="tapebd5e8e5-a0"/>
Jul 24 18:01:22 user nova-compute[70375]:     </interface>
Jul 24 18:01:22 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:01:22 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19/console.log" append="off"/>
Jul 24 18:01:22 user nova-compute[70375]:     </serial>
Jul 24 18:01:22 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:01:22 user nova-compute[70375]:     <video>
Jul 24 18:01:22 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:01:22 user nova-compute[70375]:     </video>
Jul 24 18:01:22 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:01:22 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:01:22 user nova-compute[70375]:     </rng>
Jul 24 18:01:22 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:01:22 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:01:22 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:01:22 user nova-compute[70375]:     </memballoon>
Jul 24 18:01:22 user nova-compute[70375]:   </devices>
Jul 24 18:01:22 user nova-compute[70375]: </domain>
Jul 24 18:01:22 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1462534967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG os_vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd5e8e5-a0, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebd5e8e5-a0, col_values=(('external_ids', {'iface-id': 'ebd5e8e5-a090-4885-a9da-91f048168fde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:8e:92', 'vm-uuid': 'd8a8c993-c271-42b4-9c7a-111a23961f19'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:22 user nova-compute[70375]: INFO os_vif [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0')
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:01:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] No VIF found with MAC fa:16:3e:6c:8e:92, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:24 user nova-compute[70375]: WARNING nova.compute.manager [req-a8b6bbce-5fb9-48f7-b4f0-f468663a1fab req-73ad4e7b-c450-46da-b07d-d5895572c24c service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state active and task_state rebuild_spawning.
Jul 24 18:01:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221686.3642125, d8a8c993-c271-42b4-9c7a-111a23961f19 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Resumed (Lifecycle Event)
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:01:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance spawned successfully.
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:01:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221686.365906, d8a8c993-c271-42b4-9c7a-111a23961f19 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Started (Lifecycle Event)
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:26 user nova-compute[70375]: WARNING nova.compute.manager [req-edc502a0-cccf-460f-af1f-2f3b7828e357 req-6c7da51f-e58a-4e17-8da1-55c3ea39758f service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state active and task_state rebuild_spawning.
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:01:26 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70375) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 18:01:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23319859-e458-464f-a5d3-3b2f9835c775 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:27 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221672.5359979, b28f6d6d-768a-4477-b20b-387acd129c18 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:27 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] VM Stopped (Lifecycle Event)
Jul 24 18:01:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-244069aa-2cbb-4510-a9c0-13b414dfc4f7 None None] [instance: b28f6d6d-768a-4477-b20b-387acd129c18] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:30 user nova-compute[70375]: INFO nova.compute.manager [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Terminating instance
Jul 24 18:01:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-unplugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] No waiting events found dispatching network-vif-unplugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-36392ee5-84d8-4dbf-9362-e2aee5453d64 req-f80c2fb0-bcf8-4c5e-8f99-393505b15a6f service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-unplugged-6abab823-a389-4e32-b881-b5848e321a1d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:01:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Instance destroyed successfully.
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.objects.instance [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lazy-loading 'resources' on Instance uuid c97c022f-1bca-4f38-b876-604724ed6442 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2101802354',display_name='tempest-SnapshotDataIntegrityTests-server-2101802354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2101802354',id=19,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDznd8hG7XCgM/G+ktCGUgpu/O/NGp0N7ABk6F1rV3k6G8kfzAIFhMYsUsDNBjFx8d5VyHfmQUWgsIoMNN26E3X9KktVirFcUUqvR5LqpRyXOmJ+wySPoyqyE65lB4nfg==',key_name='tempest-keypair-780072467',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:54:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b188edaccf4940b78b1b1186d66533d9',ramdisk_id='',reservation_id='r-0k7m5b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1703304380',owner_user_name='tempest-SnapshotDataIntegrityTests-1703304380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfe078158d1b47a2b3d162244d02ecda',uuid=c97c022f-1bca-4f38-b876-604724ed6442,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converting VIF {"id": "6abab823-a389-4e32-b881-b5848e321a1d", "address": "fa:16:3e:fa:aa:7f", "network": {"id": "453eac37-ded7-4911-a18d-0fc6ad180c7f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1622115661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b188edaccf4940b78b1b1186d66533d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abab823-a3", "ovs_interfaceid": "6abab823-a389-4e32-b881-b5848e321a1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG os_vif [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abab823-a3, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:01:31 user nova-compute[70375]: INFO os_vif [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:aa:7f,bridge_name='br-int',has_traffic_filtering=True,id=6abab823-a389-4e32-b881-b5848e321a1d,network=Network(453eac37-ded7-4911-a18d-0fc6ad180c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abab823-a3')
Jul 24 18:01:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Deleting instance files /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442_del
Jul 24 18:01:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Deletion of /opt/stack/data/nova/instances/c97c022f-1bca-4f38-b876-604724ed6442_del complete
Jul 24 18:01:31 user nova-compute[70375]: INFO nova.compute.manager [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 18:01:31 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-aff98a98-f55d-43ef-b79b-67fa46b74ab7 req-66738dbe-f4c1-43b8-8c66-abcb10b44032 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-deleted-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:32 user nova-compute[70375]: INFO nova.compute.manager [req-aff98a98-f55d-43ef-b79b-67fa46b74ab7 req-66738dbe-f4c1-43b8-8c66-abcb10b44032 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Neutron deleted interface 6abab823-a389-4e32-b881-b5848e321a1d; detaching it from the instance and deleting it from the info cache
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-aff98a98-f55d-43ef-b79b-67fa46b74ab7 req-66738dbe-f4c1-43b8-8c66-abcb10b44032 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:32 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Took 0.92 seconds to deallocate network for instance.
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-aff98a98-f55d-43ef-b79b-67fa46b74ab7 req-66738dbe-f4c1-43b8-8c66-abcb10b44032 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Detach interface failed, port_id=6abab823-a389-4e32-b881-b5848e321a1d, reason: Instance c97c022f-1bca-4f38-b876-604724ed6442 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] Acquiring lock "c97c022f-1bca-4f38-b876-604724ed6442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] Lock "c97c022f-1bca-4f38-b876-604724ed6442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] No waiting events found dispatching network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:32 user nova-compute[70375]: WARNING nova.compute.manager [req-36ce50f7-a153-41c4-9f2a-5db607b070e1 req-52df20ec-b4ed-46c5-bcc6-4021ee9d1f92 service nova] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Received unexpected event network-vif-plugged-6abab823-a389-4e32-b881-b5848e321a1d for instance with vm_state deleted and task_state None.
Jul 24 18:01:32 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Deleted allocations for instance c97c022f-1bca-4f38-b876-604724ed6442
Jul 24 18:01:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cc4737c3-f056-4c8f-bd3e-74ea75568fa6 tempest-SnapshotDataIntegrityTests-1703304380 tempest-SnapshotDataIntegrityTests-1703304380-project-member] Lock "c97c022f-1bca-4f38-b876-604724ed6442" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.466s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:01:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7300MB free_disk=24.174114227294922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ded94bc6-f0cf-47c7-b951-617d636c8121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d8a8c993-c271-42b4-9c7a-111a23961f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:01:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:01:40 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:01:40 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:01:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:01:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:46 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221691.1711047, c97c022f-1bca-4f38-b876-604724ed6442 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:01:46 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c97c022f-1bca-4f38-b876-604724ed6442] VM Stopped (Lifecycle Event)
Jul 24 18:01:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53785b37-31c3-4b24-8b63-c47b481bd81a None None] [instance: c97c022f-1bca-4f38-b876-604724ed6442] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:01:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:51 user nova-compute[70375]: INFO nova.compute.manager [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Detaching volume b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:01:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:51 user nova-compute[70375]: INFO nova.virt.block_device [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Attempting to driver detach volume b2045b92-9d10-4779-b5f0-c60ccd98aed6 from mountpoint /dev/vdb
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Attempting to detach device vdb from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:01:51 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:51 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:01:51 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:01:51 user nova-compute[70375]:   <serial>b2045b92-9d10-4779-b5f0-c60ccd98aed6</serial>
Jul 24 18:01:51 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:01:51 user nova-compute[70375]: </disk>
Jul 24 18:01:51 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:01:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully detached device vdb from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the persistent domain config.
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:01:51 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:51 user nova-compute[70375]:   <source dev="/dev/sde"/>
Jul 24 18:01:51 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:01:51 user nova-compute[70375]:   <serial>b2045b92-9d10-4779-b5f0-c60ccd98aed6</serial>
Jul 24 18:01:51 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:01:51 user nova-compute[70375]: </disk>
Jul 24 18:01:51 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221711.7621882, ded94bc6-f0cf-47c7-b951-617d636c8121 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:01:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully detached device vdb from instance ded94bc6-f0cf-47c7-b951-617d636c8121 from the live domain config.
Jul 24 18:01:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGOatbeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:51 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd3e5d-045e-4882-b8f1-267a66e03ca2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:01:51 user nova-compute[70375]: No targets found.
Jul 24 18:01:51 user nova-compute[70375]: iSNS:
Jul 24 18:01:51 user nova-compute[70375]: No targets found.
Jul 24 18:01:51 user nova-compute[70375]: STATIC:
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:01:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:51 user nova-compute[70375]: FIRMWARE:
Jul 24 18:01:51 user nova-compute[70375]: No targets found.
Jul 24 18:01:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:01:51 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:01:51 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8e842-13f3-4945-ae8d-067fea4a185f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[064d3e3a-5d17-4312-98d6-a4723f3fd0e3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:51 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6483d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0eb39b-98cd-404a-9469-b8303eb2e810]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a62437-ad5f-4bb6-bfc8-6464f2c8659f]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34c0a1-3f0a-4374-9b48-17401671c40a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2bd784-20f3-4b93-a5a1-f863bada0c71]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:01:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e13ee5-2d53-447d-8e78-b355ed5fe068]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[53177f4c-3c41-45a5-8d46-fa5d7239c22c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260]
Jul 24 18:01:52 user nova-compute[70375]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2045b92-9d10-4779-b5f0-c60ccd98aed6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1fa8fc-ecbc-4608-a59b-cc5ded0ae1a2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] <== disconnect_volume: return (346ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'flavor' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-86fac356-0049-4463-bd21-112b70da993e tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing instance network info cache due to event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:01:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updated VIF entry in instance network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b3d62340-d62f-4a04-a172-0f606dbf3b7b req-28ee75b1-0e87-4294-9954-61cbc0aac4b2 service nova] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:54 user nova-compute[70375]: INFO nova.compute.manager [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Detaching volume e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:01:54 user nova-compute[70375]: INFO nova.virt.block_device [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Attempting to driver detach volume e551c655-fc53-422f-9934-af24a409a415 from mountpoint /dev/vdb
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Attempting to detach device vdb from instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:01:54 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:54 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:01:54 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:01:54 user nova-compute[70375]:   <serial>e551c655-fc53-422f-9934-af24a409a415</serial>
Jul 24 18:01:54 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:01:54 user nova-compute[70375]: </disk>
Jul 24 18:01:54 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:01:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully detached device vdb from instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f from the persistent domain config.
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:01:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:01:54 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:01:54 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:01:54 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:01:54 user nova-compute[70375]:   <serial>e551c655-fc53-422f-9934-af24a409a415</serial>
Jul 24 18:01:54 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:01:54 user nova-compute[70375]: </disk>
Jul 24 18:01:54 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221715.042842, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:01:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully detached device vdb from instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f from the live domain config.
Jul 24 18:01:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXRvGgUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:01:55 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1095da-d4c0-4d91-9334-5159d8886889]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:01:55 user nova-compute[70375]: No targets found.
Jul 24 18:01:55 user nova-compute[70375]: iSNS:
Jul 24 18:01:55 user nova-compute[70375]: No targets found.
Jul 24 18:01:55 user nova-compute[70375]: STATIC:
Jul 24 18:01:55 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415
Jul 24 18:01:55 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:55 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:55 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:01:55 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:55 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:55 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:01:55 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:55 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:55 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:01:55 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:55 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:55 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:01:55 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:01:55 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:01:55 user nova-compute[70375]: FIRMWARE:
Jul 24 18:01:55 user nova-compute[70375]: No targets found.
Jul 24 18:01:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:01:55 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:01:55 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc899269-bc26-4ade-8021-12716832f33d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[89582481-fbe8-4f79-8319-0eb4a24634ca]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:01:55 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:01:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe65128df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc35bf-0651-44b1-966a-67588fe7dd2d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35f67d8-eca0-4b3c-b3b0-69ad50c37a1a]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a17bcdc-e24b-49e9-af6f-ab546f045aa5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20e3ac-8236-43ab-ba09-9ef784b4aee6]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc8a1a-9294-490c-b660-81593783c87e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31b3de3-50dc-4a64-b62b-8a59cbda61b9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260]
Jul 24 18:01:55 user nova-compute[70375]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415, portal: 172.16.0.220,3260] successful.
Jul 24 18:01:55 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e551c655-fc53-422f-9934-af24a409a415 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[917981a4-1a92-41dd-a5e1-a4600bac168c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] <== disconnect_volume: return (321ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:01:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing instance network info cache due to event network-changed-08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Refreshing network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'flavor' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2b0014a3-a6c7-45ae-8b66-2bb1a2dbcfbd tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updated VIF entry in instance network info cache for port 08be5745-5810-4b4d-b53c-5efb8aee4493. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b75b1bd-c968-44f1-9b0d-ab5904399d46 req-ad3b6339-f8a8-4fd5-a01b-19ada9013aaf service nova] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:57 user nova-compute[70375]: INFO nova.compute.manager [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Unrescuing
Jul 24 18:01:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:01:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:01:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'flavor' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:01:58 user nova-compute[70375]: WARNING nova.compute.manager [req-1c58da5e-19f8-43c0-9f8b-a413c4d5bd2b req-99fb6086-344c-49d8-83f3-1e7d299165dc service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:01:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:01:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance destroyed successfully.
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:00 user nova-compute[70375]: WARNING nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:02:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:00 user nova-compute[70375]: WARNING nova.compute.manager [req-df302b72-547a-4806-abb4-d61a129ccfec req-13c93418-f0cb-4ec2-b52e-b6e3679d49ca service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:02:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 0f4dbd9f-5580-4c29-86b9-cc35d7768715 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221722.713076, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:02:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Resumed (Lifecycle Event)
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1718c023-4bdc-498b-9277-a51c6ad84fb3 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:02:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221722.7165558, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:02:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Started (Lifecycle Event)
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:02 user nova-compute[70375]: WARNING nova.compute.manager [req-c60a5725-6d22-4796-8a7b-ac8f7f391b20 req-18274a21-8e45-42be-8da5-fac211d71009 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state None.
Jul 24 18:02:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:02:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:02:31 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [{"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-cc5ce8b4-e6f3-4af1-a829-7883fac5847f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:02:39 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7454MB free_disk=24.163494110107422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance ded94bc6-f0cf-47c7-b951-617d636c8121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d8a8c993-c271-42b4-9c7a-111a23961f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:02:39 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:02:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:02:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:02:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:44 user nova-compute[70375]: INFO nova.compute.manager [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Terminating instance
Jul 24 18:02:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:44 user nova-compute[70375]: INFO nova.compute.manager [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Terminating instance
Jul 24 18:02:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:02:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-59b83992-d3fb-4b49-afee-5ecd8ffc2bce req-c4526b2b-02ed-42cd-bf33-65d21d8827d3 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-unplugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Instance destroyed successfully.
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'resources' on Instance uuid d8a8c993-c271-42b4-9c7a-111a23961f19 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Instance destroyed successfully.
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid cc5ce8b4-e6f3-4af1-a829-7883fac5847f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1462534967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2029243753',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/TLPr3RYVOXHogs2M9mSI0UzgTNOiFi12Ewk1yUha0yPcHh8ceoIcfPYDpPrNne3oq5YqX50yq7DSfhrfVYBQoYFGXIfCuSVJEARorzjOAbdmGielx0p8FvnTgx1KqRg==',key_name='tempest-keypair-323107175',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-am2i3pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:01:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=d8a8c993-c271-42b4-9c7a-111a23961f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "ebd5e8e5-a090-4885-a9da-91f048168fde", "address": "fa:16:3e:6c:8e:92", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd5e8e5-a0", "ovs_interfaceid": "ebd5e8e5-a090-4885-a9da-91f048168fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_vif [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:56:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-455018711',display_name='tempest-ServerRescueNegativeTestJSON-server-455018711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-455018711',id=22,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+8SRWG8T879MTkJiAHYD9M7E41i9CLX+vusUYAP34t9JA4nlLHTCzh7iAF8gyma58NeSrVAG4czVm/LUYJuauLp7OYHrWzE77OIf/Q7JjWeXUYMLskrjBdCVxJ5Yq53g==',key_name='tempest-keypair-1631665804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-yjbhp7to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=cc5ce8b4-e6f3-4af1-a829-7883fac5847f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "08be5745-5810-4b4d-b53c-5efb8aee4493", "address": "fa:16:3e:07:ee:a1", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be5745-58", "ovs_interfaceid": "08be5745-5810-4b4d-b53c-5efb8aee4493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_vif [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd5e8e5-a0, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08be5745-58, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:02:45 user nova-compute[70375]: INFO os_vif [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:8e:92,bridge_name='br-int',has_traffic_filtering=True,id=ebd5e8e5-a090-4885-a9da-91f048168fde,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd5e8e5-a0')
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcdhHNOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:02:45 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:02:45 user nova-compute[70375]: INFO os_vif [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ee:a1,bridge_name='br-int',has_traffic_filtering=True,id=08be5745-5810-4b4d-b53c-5efb8aee4493,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be5745-58')
Jul 24 18:02:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Deleting instance files /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f_del
Jul 24 18:02:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Deletion of /opt/stack/data/nova/instances/cc5ce8b4-e6f3-4af1-a829-7883fac5847f_del complete
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94212f0d-0d5c-48b8-b050-c785698dcf10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:02:45 user nova-compute[70375]: No targets found.
Jul 24 18:02:45 user nova-compute[70375]: iSNS:
Jul 24 18:02:45 user nova-compute[70375]: No targets found.
Jul 24 18:02:45 user nova-compute[70375]: STATIC:
Jul 24 18:02:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:02:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe
Jul 24 18:02:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:02:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:02:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:45 user nova-compute[70375]: FIRMWARE:
Jul 24 18:02:45 user nova-compute[70375]: No targets found.
Jul 24 18:02:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:02:45 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:02:45 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e706125e-60ef-46f3-b205-4c5c88cc9d15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:45 user nova-compute[70375]: INFO nova.compute.manager [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7c3b06-d26e-4152-b0d5-a0e6053bf5f4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:02:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:02:45 user nova-compute[70375]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe (non-flash)
Jul 24 18:02:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6305c3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe'): ({'sdg'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Removing single pathed devices sdg {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f287eb8-8126-4fd2-80f8-4216abc3dd1d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31c38c-8883-4784-acfd-01b62bf14fab]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Flushing IO for device /dev/sdg {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de20af4-9b9b-4bd6-8073-4fb1cefdca36]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238962c-dc77-4c03-8eec-82903a0748c6]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] SCSI volumes sdg have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03c76f-7950-4961-ba4c-045d943d955c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b045435c-9ddd-4860-a7e9-210a8e13dc01]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260]
Jul 24 18:02:46 user nova-compute[70375]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe, portal: 172.16.0.220,3260] successful.
Jul 24 18:02:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e28b1f5-6ef3-4050-897d-ab56781c4efe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[188d4e89-1d20-4f09-b3a7-1615f47735cc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] <== disconnect_volume: return (377ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:02:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deleting instance files /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19_del
Jul 24 18:02:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deletion of /opt/stack/data/nova/instances/d8a8c993-c271-42b4-9c7a-111a23961f19_del complete
Jul 24 18:02:46 user nova-compute[70375]: INFO nova.compute.manager [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Took 1.64 seconds to destroy the instance on the hypervisor.
Jul 24 18:02:46 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:02:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] No waiting events found dispatching network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: WARNING nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received unexpected event network-vif-plugged-ebd5e8e5-a090-4885-a9da-91f048168fde for instance with vm_state active and task_state deleting.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: WARNING nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state deleting.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: WARNING nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state deleting.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: WARNING nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state deleting.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-unplugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Acquiring lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] No waiting events found dispatching network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:47 user nova-compute[70375]: WARNING nova.compute.manager [req-2afb6894-3cd8-49cf-a074-12c1bb6087c5 req-4dff353d-89ba-4249-9893-a6ca827d98b1 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received unexpected event network-vif-plugged-08be5745-5810-4b4d-b53c-5efb8aee4493 for instance with vm_state active and task_state deleting.
Jul 24 18:02:47 user nova-compute[70375]: INFO nova.compute.manager [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Terminating instance
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Instance destroyed successfully.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lazy-loading 'resources' on Instance uuid ded94bc6-f0cf-47c7-b951-617d636c8121 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-659321617',display_name='tempest-TestServerVolumeAttachmentScenario-server-659321617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-659321617',id=26,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaZ7LWSo/83GQkHdmgaZWKv0XN5Wn0Kmmia8a7FpGPEGtPGApEjYX76LDctry/urjFAidvB1nu6HeG9uC5Sxfi40OZ9zl7yV1pDXXxIYfxvwRVoA4wtbc+lsNfsm3PzJA==',key_name='tempest-keypair-937863538',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8dc7f17f00748bb96e22f0a6a7429cc',ramdisk_id='',reservation_id='r-vxtr2dav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448539370',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448539370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3685b4353c345888a4c3677ecdef3d2',uuid=ded94bc6-f0cf-47c7-b951-617d636c8121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converting VIF {"id": "5549309b-3614-4cbc-9881-9fe88f191123", "address": "fa:16:3e:8d:cb:76", "network": {"id": "feeb0d04-8434-4632-923d-f2b18a78fa22", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-265173149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8dc7f17f00748bb96e22f0a6a7429cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5549309b-36", "ovs_interfaceid": "5549309b-3614-4cbc-9881-9fe88f191123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG os_vif [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5549309b-36, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:02:47 user nova-compute[70375]: INFO os_vif [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cb:76,bridge_name='br-int',has_traffic_filtering=True,id=5549309b-3614-4cbc-9881-9fe88f191123,network=Network(feeb0d04-8434-4632-923d-f2b18a78fa22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5549309b-36')
Jul 24 18:02:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Deleting instance files /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121_del
Jul 24 18:02:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Deletion of /opt/stack/data/nova/instances/ded94bc6-f0cf-47c7-b951-617d636c8121_del complete
Jul 24 18:02:47 user nova-compute[70375]: INFO nova.compute.manager [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 18:02:47 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:02:47 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:48 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Took 2.52 seconds to deallocate network for instance.
Jul 24 18:02:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-330e0b8e-46aa-4dce-a7c1-4c741f8c1f49 req-ba11ebea-9a47-4093-96f8-c7eb96b39c33 service nova] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Received event network-vif-deleted-08be5745-5810-4b4d-b53c-5efb8aee4493 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:02:48 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:48 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Took 2.61 seconds to deallocate network for instance.
Jul 24 18:02:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:48 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Deleted allocations for instance cc5ce8b4-e6f3-4af1-a829-7883fac5847f
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aac10bf3-5863-4397-aa90-d79e48a3b4ce tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "cc5ce8b4-e6f3-4af1-a829-7883fac5847f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.093s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-unplugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] No waiting events found dispatching network-vif-unplugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-unplugged-5549309b-3614-4cbc-9881-9fe88f191123 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Acquiring lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] No waiting events found dispatching network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:02:49 user nova-compute[70375]: WARNING nova.compute.manager [req-447fdc44-0038-4e5e-be73-796b8470b03c req-c4d6611e-a865-4d14-a9df-3ba1a3647e1c service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received unexpected event network-vif-plugged-5549309b-3614-4cbc-9881-9fe88f191123 for instance with vm_state active and task_state deleting.
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:49 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Took 1.34 seconds to deallocate network for instance.
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-46a7964d-9317-4026-8222-4abe545e357c req-d7b4dd7d-2b14-4753-9621-b586f4955da3 service nova] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Received event network-vif-deleted-5549309b-3614-4cbc-9881-9fe88f191123 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:49 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Deleted allocations for instance ded94bc6-f0cf-47c7-b951-617d636c8121
Jul 24 18:02:49 user nova-compute[70375]: INFO nova.compute.manager [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Took 0.91 seconds to detach 1 volumes for instance.
Jul 24 18:02:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Deleting volume: 9e28b1f5-6ef3-4050-897d-ab56781c4efe {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b05f73e4-7289-48fe-abfe-ecef135741b0 tempest-TestServerVolumeAttachmentScenario-448539370 tempest-TestServerVolumeAttachmentScenario-448539370-project-member] Lock "ded94bc6-f0cf-47c7-b951-617d636c8121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.753s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:50 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:02:50 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:02:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:50 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Deleted allocations for instance d8a8c993-c271-42b4-9c7a-111a23961f19
Jul 24 18:02:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9db1421b-f33c-46f8-9f51-092bfa958627 tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "d8a8c993-c271-42b4-9c7a-111a23961f19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.834s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-c4f45743-5989-4923-9287-039446f7bc52 req-65e663ff-f880-476d-a22a-66667dcba68b service nova] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Received event network-vif-deleted-ebd5e8e5-a090-4885-a9da-91f048168fde {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-changed-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing instance network info cache due to event network-changed-216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing instance network info cache due to event network-changed-cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Refreshing network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updated VIF entry in instance network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a938c8c6-5c68-4b07-b373-5d1790e2c39d req-74cc9d63-e35e-4cf3-b6d7-cacb42100d14 service nova] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated VIF entry in instance network info cache for port cc33dfa8-db53-43b9-846b-e8f09e846c71. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-777e803d-d998-4558-8f48-0cd8487fb7c1 req-553c540f-8468-43b2-add0-b7b8ce207493 service nova] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-changed-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing instance network info cache due to event network-changed-216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] Acquiring lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] Acquired lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Refreshing network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:57 user nova-compute[70375]: INFO nova.compute.manager [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Detaching volume e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:02:57 user nova-compute[70375]: INFO nova.virt.block_device [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Attempting to driver detach volume e0254199-3ea8-4b9e-be2b-94dffbfd7416 from mountpoint /dev/vdb
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Attempting to detach device vdb from instance 55e5e70a-02e5-4363-89b3-02cef5942015 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:02:57 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:02:57 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 18:02:57 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:02:57 user nova-compute[70375]:   <serial>e0254199-3ea8-4b9e-be2b-94dffbfd7416</serial>
Jul 24 18:02:57 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:02:57 user nova-compute[70375]: </disk>
Jul 24 18:02:57 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:02:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully detached device vdb from instance 55e5e70a-02e5-4363-89b3-02cef5942015 from the persistent domain config.
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55e5e70a-02e5-4363-89b3-02cef5942015 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:02:57 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:02:57 user nova-compute[70375]:   <source dev="/dev/sdf"/>
Jul 24 18:02:57 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:02:57 user nova-compute[70375]:   <serial>e0254199-3ea8-4b9e-be2b-94dffbfd7416</serial>
Jul 24 18:02:57 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:02:57 user nova-compute[70375]: </disk>
Jul 24 18:02:57 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690221777.7496376, 55e5e70a-02e5-4363-89b3-02cef5942015 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:02:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully detached device vdb from instance 55e5e70a-02e5-4363-89b3-02cef5942015 from the live domain config.
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCEVuAUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:02:57 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d181b7-2325-435a-8fea-111e8d41773e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:02:57 user nova-compute[70375]: No targets found.
Jul 24 18:02:57 user nova-compute[70375]: iSNS:
Jul 24 18:02:57 user nova-compute[70375]: No targets found.
Jul 24 18:02:57 user nova-compute[70375]: STATIC:
Jul 24 18:02:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416
Jul 24 18:02:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:02:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:02:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:02:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:02:57 user nova-compute[70375]: FIRMWARE:
Jul 24 18:02:57 user nova-compute[70375]: No targets found.
Jul 24 18:02:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:02:57 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:02:57 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb73183-595a-4661-90e4-c0229ab985e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1c860-daca-4255-a894-93e46601913d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:02:57 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:02:57 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:02:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:02:57 user nova-compute[70375]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 (non-flash)
Jul 24 18:02:57 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:02:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6501b8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updated VIF entry in instance network info cache for port 216d7d69-3422-4e84-8525-4494e06baa85. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [{"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c444b3-62e9-4e28-ad91-9c61ab0fc481]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d3193e4-dc3c-4ec4-ba19-d21f6d698bdc req-6603dc8a-166e-4f88-921b-a4dfb9177e27 service nova] Releasing lock "refresh_cache-55e5e70a-02e5-4363-89b3-02cef5942015" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[65baf94f-6f32-4e58-8283-783c473f49f7]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[45899113-ae4d-4310-9ad0-bd71db6997f8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd94eaf8-9659-4695-9919-7a15a2d62e0a]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9450c8-374d-4a4d-b3e7-4d3faf25f91f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4506d46-691c-4a5b-8fe7-2862ac92544c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260]
Jul 24 18:02:58 user nova-compute[70375]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416, portal: 172.16.0.220,3260] successful.
Jul 24 18:02:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0254199-3ea8-4b9e-be2b-94dffbfd7416 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50653c-1890-4ef7-842d-0a80e01071db]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== disconnect_volume: return (314ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-changed-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Refreshing instance network info cache due to event network-changed-9adfd0ef-ef85-4592-be45-816bdf90235d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Refreshing network info cache for port 9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Stashing vm_state: active {{(pid=70375) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_requests' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:02:58 user nova-compute[70375]: INFO nova.compute.claims [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Claim successful on node user
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'resources' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:58 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating resource usage from migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fccdc970-a53a-4aa2-91e1-96825995f81d tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:58 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.423s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:02:59 user nova-compute[70375]: INFO nova.compute.manager [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Migrating
Jul 24 18:02:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updated VIF entry in instance network info cache for port 9adfd0ef-ef85-4592-be45-816bdf90235d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7229bd76-71ca-476d-ae20-0e287afaf2b2 req-59b99064-f819-4d60-a5d2-b1e786823802 service nova] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:02:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Starting migrate_disk_and_power_off {{(pid=70375) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:00 user nova-compute[70375]: WARNING nova.compute.manager [req-2c7da34f-6f99-4ab5-bfc9-d72535302662 req-41da0358-cf73-4da0-8f4c-34cb5c318187 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state active and task_state resize_migrating.
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221765.728705, d8a8c993-c271-42b4-9c7a-111a23961f19 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:00 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] VM Stopped (Lifecycle Event)
Jul 24 18:03:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221765.7511528, cc5ce8b4-e6f3-4af1-a829-7883fac5847f => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:00 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] VM Stopped (Lifecycle Event)
Jul 24 18:03:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ffabdd4d-44d1-42d6-bd2c-adf7d1885ddf None None] [instance: cc5ce8b4-e6f3-4af1-a829-7883fac5847f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7b132fc6-9cc5-4cca-9cc1-f0eded55a9a3 None None] [instance: d8a8c993-c271-42b4-9c7a-111a23961f19] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:01 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance destroyed successfully.
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9adfd0ef-ef, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:01 user nova-compute[70375]: INFO os_vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef')
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:03:01 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d1b92-67b8-4670-8011-1252be6e87f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:03:01 user nova-compute[70375]: No targets found.
Jul 24 18:03:01 user nova-compute[70375]: iSNS:
Jul 24 18:03:01 user nova-compute[70375]: No targets found.
Jul 24 18:03:01 user nova-compute[70375]: STATIC:
Jul 24 18:03:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:03:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:03:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:03:01 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:03:01 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:03:01 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:03:01 user nova-compute[70375]: FIRMWARE:
Jul 24 18:03:01 user nova-compute[70375]: No targets found.
Jul 24 18:03:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:03:01 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:03:01 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093502f-1c43-47d8-9656-d7399aec5325]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5afa4-1f3b-48ee-9b46-3f8f355b0a47]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:01 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:03:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:01 user nova-compute[70375]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:03:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe656aaec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe98a24-f3de-4f57-8bb1-6a4aa06a0ddd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db2612-c62c-4325-a907-4f659fcabd0b]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dfbb0d-de5e-4a5a-883f-59a38a180161]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67542ac-907f-494e-a92e-38103fbf7621]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_87b78751', '/dev/disk/by-id/scsi-23262666661323337', '/dev/disk/by-id/scsi-1SCST_BIO87b78751-2bffa237cd82f836') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2f3bd9-81d9-4c83-b897-900450da7a4a]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c1dc0-6851-4295-9384-96279edd267a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6f22b-b731-4f45-8b63-cadfff7f539a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]
Jul 24 18:03:01 user nova-compute[70375]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.
Jul 24 18:03:01 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3efd9a-828c-448c-83e5-11ce3051eefe]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== disconnect_volume: return (317ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:03:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Port 9adfd0ef-ef85-4592-be45-816bdf90235d binding to destination host user is already ACTIVE {{(pid=70375) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:02 user nova-compute[70375]: WARNING nova.compute.manager [req-5aa5a6d5-6509-47f6-ba0e-7544fe70e9ce req-04de208a-365d-45e5-842e-9d49a1805a64 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state active and task_state resize_migrated.
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221767.8771608, ded94bc6-f0cf-47c7-b951-617d636c8121 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:02 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] VM Stopped (Lifecycle Event)
Jul 24 18:03:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-435ec048-6997-4e6e-ba0d-6c20befb834c None None] [instance: ded94bc6-f0cf-47c7-b951-617d636c8121] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.utils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb519ce-867b-432f-b6f9-a1ef3df4ae42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b3edf-2885-4778-b01b-ec1ea7444e25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bcc306-5382-49be-815e-82ff2bf6d89f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f51f188-6957-48cc-9432-68265d4748e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:03:03 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:03:03 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b770e05-7abd-4619-9460-9e6766243859]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:03:03 user nova-compute[70375]: DEBUG os_brick.utils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:03:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Starting finish_migration {{(pid=70375) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 18:03:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Creating image(s)
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Ensure instance console log exists: /opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start _get_guest_xml network_info=[{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '61e32754-5566-41a1-b804-ecd7c541e9c6', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8fec2e88-1d18-4b2b-b8e4-b03d39c9646f', 'attached_at': '2023-07-24T18:03:10.000000', 'detached_at': '', 'volume_id': '58e4e392-68f3-4083-8350-1fb33054bf5b', 'serial': '58e4e392-68f3-4083-8350-1fb33054bf5b'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:03:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:03:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:03:10 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:03:10 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cabd98f-3a3c-428c-b732-4ca8d186ce38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:03:10 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cca68-dba8-42f6-a77a-589c70922e42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b] added
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2c6b50-1e60-4b41-942f-e45472b0b3a8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0af8621-c40f-4699-86ce-3801f22c9c18]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrFhECZA {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrFhECZA" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa4e6d-20ee-4018-bbb8-af15f0a3e1cf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrFhECZA'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f98d9-365f-470b-9ab7-b3e8c34054d7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f24e8d-e57a-4fbf-8c29-301b7bfb5874]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb1cb14-4bbd-438a-9e2b-8dad9d07e5ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]
Jul 24 18:03:11 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d7025-a927-45dd-adf0-5fcfca7b088c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae86cab8-92e7-476c-9b09-fd3faae4e04a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:11 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:03:11 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:03:11 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[476dc8f7-4225-449f-82eb-2927d5882895]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:03:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23262666661323337', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666661323337', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:03:12 user nova-compute[70375]:   <uuid>8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</uuid>
Jul 24 18:03:12 user nova-compute[70375]:   <name>instance-0000001d</name>
Jul 24 18:03:12 user nova-compute[70375]:   <memory>2097152</memory>
Jul 24 18:03:12 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:03:12 user nova-compute[70375]:   <metadata>
Jul 24 18:03:12 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:03:12 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:03:12 user nova-compute[70375]:       <nova:name>tempest-ServerActionsTestOtherA-server-1833106531</nova:name>
Jul 24 18:03:12 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:03:10</nova:creationTime>
Jul 24 18:03:12 user nova-compute[70375]:       <nova:flavor name="m1.small">
Jul 24 18:03:12 user nova-compute[70375]:         <nova:memory>2048</nova:memory>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:disk>20</nova:disk>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:03:12 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:03:12 user nova-compute[70375]:       <nova:owner>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:user uuid="aa75ae32ac1049f794ce2f8433df6529">tempest-ServerActionsTestOtherA-528723047-project-member</nova:user>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:project uuid="d07a82b57ae84e8892d950cdc0d7507b">tempest-ServerActionsTestOtherA-528723047</nova:project>
Jul 24 18:03:12 user nova-compute[70375]:       </nova:owner>
Jul 24 18:03:12 user nova-compute[70375]:       <nova:ports>
Jul 24 18:03:12 user nova-compute[70375]:         <nova:port uuid="9adfd0ef-ef85-4592-be45-816bdf90235d">
Jul 24 18:03:12 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 18:03:12 user nova-compute[70375]:         </nova:port>
Jul 24 18:03:12 user nova-compute[70375]:       </nova:ports>
Jul 24 18:03:12 user nova-compute[70375]:     </nova:instance>
Jul 24 18:03:12 user nova-compute[70375]:   </metadata>
Jul 24 18:03:12 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:03:12 user nova-compute[70375]:     <system>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="serial">8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</entry>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="uuid">8fec2e88-1d18-4b2b-b8e4-b03d39c9646f</entry>
Jul 24 18:03:12 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:03:12 user nova-compute[70375]:     </system>
Jul 24 18:03:12 user nova-compute[70375]:   </sysinfo>
Jul 24 18:03:12 user nova-compute[70375]:   <os>
Jul 24 18:03:12 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:03:12 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:03:12 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:03:12 user nova-compute[70375]:   </os>
Jul 24 18:03:12 user nova-compute[70375]:   <features>
Jul 24 18:03:12 user nova-compute[70375]:     <acpi/>
Jul 24 18:03:12 user nova-compute[70375]:     <apic/>
Jul 24 18:03:12 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:03:12 user nova-compute[70375]:   </features>
Jul 24 18:03:12 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:03:12 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:03:12 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:03:12 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:03:12 user nova-compute[70375]:   </clock>
Jul 24 18:03:12 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:03:12 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:03:12 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:03:12 user nova-compute[70375]:   </cpu>
Jul 24 18:03:12 user nova-compute[70375]:   <devices>
Jul 24 18:03:12 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:03:12 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:03:12 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:03:12 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:03:12 user nova-compute[70375]:       <serial>58e4e392-68f3-4083-8350-1fb33054bf5b</serial>
Jul 24 18:03:12 user nova-compute[70375]:     </disk>
Jul 24 18:03:12 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:03:12 user nova-compute[70375]:       <mac address="fa:16:3e:f7:0f:1a"/>
Jul 24 18:03:12 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:12 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:03:12 user nova-compute[70375]:       <target dev="tap9adfd0ef-ef"/>
Jul 24 18:03:12 user nova-compute[70375]:     </interface>
Jul 24 18:03:12 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:03:12 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f/console.log" append="off"/>
Jul 24 18:03:12 user nova-compute[70375]:     </serial>
Jul 24 18:03:12 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:03:12 user nova-compute[70375]:     <video>
Jul 24 18:03:12 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:12 user nova-compute[70375]:     </video>
Jul 24 18:03:12 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:03:12 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:03:12 user nova-compute[70375]:     </rng>
Jul 24 18:03:12 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:03:12 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:03:12 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:03:12 user nova-compute[70375]:     </memballoon>
Jul 24 18:03:12 user nova-compute[70375]:   </devices>
Jul 24 18:03:12 user nova-compute[70375]: </domain>
Jul 24 18:03:12 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1805606292-network", "vif_mac": "fa:16:3e:f7:0f:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG os_vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9adfd0ef-ef, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9adfd0ef-ef, col_values=(('external_ids', {'iface-id': '9adfd0ef-ef85-4592-be45-816bdf90235d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:0f:1a', 'vm-uuid': '8fec2e88-1d18-4b2b-b8e4-b03d39c9646f'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:12 user nova-compute[70375]: INFO os_vif [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef')
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:03:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] No VIF found with MAC fa:16:3e:f7:0f:1a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:13 user nova-compute[70375]: DEBUG nova.compute.manager [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:13 user nova-compute[70375]: WARNING nova.compute.manager [req-11c0cddf-d608-4853-bb02-162567386f03 req-5dd1a60e-50a1-477f-aa46-6f3bad577cf7 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state active and task_state resize_finish.
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.compute.claims [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Claim successful on node user
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221795.7600265, 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] VM Resumed (Lifecycle Event)
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance running successfully.
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Failed to set time: agent not configured {{(pid=70375) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-29690127-4944-4179-abc8-0c802ebb3a35 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] finish_migration finished successfully. {{(pid=70375) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221795.7643702, 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] VM Started (Lifecycle Event)
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:15 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:15 user nova-compute[70375]: WARNING nova.compute.manager [req-c509a025-185b-44b7-ac13-da4452d14491 req-2fa402f4-a572-4ad1-87dd-b34b95cad3a9 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state active and task_state resize_finish.
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:03:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:03:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Creating image(s)
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "/opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "/opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.policy [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fe174981b81427cbbc6fbb54f25a276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee82f625b7940668757a85524cb553f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk 1073741824" returned: 0 in 0.046s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Cannot resize image /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lazy-loading 'migration_context' on Instance uuid 7cc13769-301c-4bfc-a700-80d45282b6e7 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Ensure instance console log exists: /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Successfully created port: 2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Successfully updated port: 2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquired lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-changed-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Refreshing instance network info cache due to event network-changed-2c7f5a8f-77f5-4d67-a151-52e576043101. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] Acquiring lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Updating instance_info_cache with network_info: [{"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Releasing lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Instance network_info: |[{"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] Acquired lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Refreshing network info cache for port 2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Start _get_guest_xml network_info=[{"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:03:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-880323083',display_name='tempest-VolumesNegativeTest-instance-880323083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-880323083',id=30,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ee82f625b7940668757a85524cb553f',ramdisk_id='',reservation_id='r-5b72jrvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2087521434',owner_user_name='tempest-VolumesNegativeTest-2087521434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:03:16Z,user_data=None,user_id='1fe174981b81427cbbc6fbb54f25a276',uuid=7cc13769-301c-4bfc-a700-80d45282b6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converting VIF {"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cc13769-301c-4bfc-a700-80d45282b6e7 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:03:18 user nova-compute[70375]:   <uuid>7cc13769-301c-4bfc-a700-80d45282b6e7</uuid>
Jul 24 18:03:18 user nova-compute[70375]:   <name>instance-0000001e</name>
Jul 24 18:03:18 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:03:18 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:03:18 user nova-compute[70375]:   <metadata>
Jul 24 18:03:18 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:03:18 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:name>tempest-VolumesNegativeTest-instance-880323083</nova:name>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:03:18</nova:creationTime>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:03:18 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:03:18 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:owner>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:user uuid="1fe174981b81427cbbc6fbb54f25a276">tempest-VolumesNegativeTest-2087521434-project-member</nova:user>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:project uuid="8ee82f625b7940668757a85524cb553f">tempest-VolumesNegativeTest-2087521434</nova:project>
Jul 24 18:03:18 user nova-compute[70375]:       </nova:owner>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:03:18 user nova-compute[70375]:       <nova:ports>
Jul 24 18:03:18 user nova-compute[70375]:         <nova:port uuid="2c7f5a8f-77f5-4d67-a151-52e576043101">
Jul 24 18:03:18 user nova-compute[70375]:           <nova:ip type="fixed" address="192.168.233.12" ipVersion="4"/>
Jul 24 18:03:18 user nova-compute[70375]:         </nova:port>
Jul 24 18:03:18 user nova-compute[70375]:       </nova:ports>
Jul 24 18:03:18 user nova-compute[70375]:     </nova:instance>
Jul 24 18:03:18 user nova-compute[70375]:   </metadata>
Jul 24 18:03:18 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:03:18 user nova-compute[70375]:     <system>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="serial">7cc13769-301c-4bfc-a700-80d45282b6e7</entry>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="uuid">7cc13769-301c-4bfc-a700-80d45282b6e7</entry>
Jul 24 18:03:18 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:03:18 user nova-compute[70375]:     </system>
Jul 24 18:03:18 user nova-compute[70375]:   </sysinfo>
Jul 24 18:03:18 user nova-compute[70375]:   <os>
Jul 24 18:03:18 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:03:18 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:03:18 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:03:18 user nova-compute[70375]:   </os>
Jul 24 18:03:18 user nova-compute[70375]:   <features>
Jul 24 18:03:18 user nova-compute[70375]:     <acpi/>
Jul 24 18:03:18 user nova-compute[70375]:     <apic/>
Jul 24 18:03:18 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:03:18 user nova-compute[70375]:   </features>
Jul 24 18:03:18 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:03:18 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:03:18 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:03:18 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:03:18 user nova-compute[70375]:   </clock>
Jul 24 18:03:18 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:03:18 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:03:18 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:03:18 user nova-compute[70375]:   </cpu>
Jul 24 18:03:18 user nova-compute[70375]:   <devices>
Jul 24 18:03:18 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:03:18 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:03:18 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk"/>
Jul 24 18:03:18 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:03:18 user nova-compute[70375]:     </disk>
Jul 24 18:03:18 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:03:18 user nova-compute[70375]:       <mac address="fa:16:3e:d7:f2:84"/>
Jul 24 18:03:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:18 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:03:18 user nova-compute[70375]:       <target dev="tap2c7f5a8f-77"/>
Jul 24 18:03:18 user nova-compute[70375]:     </interface>
Jul 24 18:03:18 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:03:18 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/console.log" append="off"/>
Jul 24 18:03:18 user nova-compute[70375]:     </serial>
Jul 24 18:03:18 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:03:18 user nova-compute[70375]:     <video>
Jul 24 18:03:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:18 user nova-compute[70375]:     </video>
Jul 24 18:03:18 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:03:18 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:03:18 user nova-compute[70375]:     </rng>
Jul 24 18:03:18 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:03:18 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:03:18 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:03:18 user nova-compute[70375]:     </memballoon>
Jul 24 18:03:18 user nova-compute[70375]:   </devices>
Jul 24 18:03:18 user nova-compute[70375]: </domain>
Jul 24 18:03:18 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-880323083',display_name='tempest-VolumesNegativeTest-instance-880323083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-880323083',id=30,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ee82f625b7940668757a85524cb553f',ramdisk_id='',reservation_id='r-5b72jrvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2087521434',owner_user_name='tempest-VolumesNegativeTest-2087521434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:03:16Z,user_data=None,user_id='1fe174981b81427cbbc6fbb54f25a276',uuid=7cc13769-301c-4bfc-a700-80d45282b6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converting VIF {"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG os_vif [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c7f5a8f-77, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c7f5a8f-77, col_values=(('external_ids', {'iface-id': '2c7f5a8f-77f5-4d67-a151-52e576043101', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:f2:84', 'vm-uuid': '7cc13769-301c-4bfc-a700-80d45282b6e7'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:18 user nova-compute[70375]: INFO os_vif [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77')
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] No VIF found with MAC fa:16:3e:d7:f2:84, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Updated VIF entry in instance network info cache for port 2c7f5a8f-77f5-4d67-a151-52e576043101. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG nova.network.neutron [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Updating instance_info_cache with network_info: [{"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b53938-3722-45f3-ac81-bbf146a0efb2 req-dbd035d6-46e8-4895-8ac1-1941b6677c27 service nova] Releasing lock "refresh_cache-7cc13769-301c-4bfc-a700-80d45282b6e7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] No waiting events found dispatching network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:20 user nova-compute[70375]: WARNING nova.compute.manager [req-c1ab17d0-df93-4722-b9e6-343bba753ef9 req-42a28a0e-c7e3-4530-b777-0ba3f2b6e625 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received unexpected event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 for instance with vm_state building and task_state spawning.
Jul 24 18:03:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221802.0923066, 7cc13769-301c-4bfc-a700-80d45282b6e7 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] VM Resumed (Lifecycle Event)
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Instance spawned successfully.
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221802.0935574, 7cc13769-301c-4bfc-a700-80d45282b6e7 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] VM Started (Lifecycle Event)
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] No waiting events found dispatching network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:22 user nova-compute[70375]: WARNING nova.compute.manager [req-92c099df-684a-408f-82e9-c6f078448bdd req-530f3b45-9cfb-4855-82ae-251df4ea8076 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received unexpected event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 for instance with vm_state building and task_state spawning.
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Took 6.03 seconds to spawn the instance on the hypervisor.
Jul 24 18:03:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:22 user nova-compute[70375]: INFO nova.compute.manager [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Took 6.75 seconds to build instance.
Jul 24 18:03:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a5318644-851b-47c2-b833-3181194a673d tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.840s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updating instance_info_cache with network_info: [{"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-44bdf20e-8189-4fdf-8c00-3ff733fb357b" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:03:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:03:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:03:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:36 user nova-compute[70375]: INFO nova.compute.manager [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Terminating instance
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-unplugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] No waiting events found dispatching network-vif-unplugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-c95c2a13-259d-46f4-8f19-59cb482f982a req-eb1291d7-b702-4efe-a5d9-3e277c094a51 service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-unplugged-a05d138d-5697-4845-abef-b690c3032e5d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:03:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Instance destroyed successfully.
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.objects.instance [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lazy-loading 'resources' on Instance uuid 44bdf20e-8189-4fdf-8c00-3ff733fb357b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-893177979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-893177979',id=23,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXiLv8uYiHK9Yr5uEtjaxpudibS8d5e22Pgb/S6+u+15r+0R/0GeTiIrwYV3cwSGgDU3LhktZoA5cbl4t3IaL8vSjAusynkuEC1o7sZwMBx6F+WDGJal4bH8CBSeKCA+w==',key_name='tempest-keypair-694518500',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa85032ee2074843ab0c0a4d27947eda',ramdisk_id='',reservation_id='r-o9ulwd00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1282122326',owner_user_name='tempest-ServerActionsV293TestJSON-1282122326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:57:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395e4ee5bd4408783d423729093834d',uuid=44bdf20e-8189-4fdf-8c00-3ff733fb357b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converting VIF {"id": "a05d138d-5697-4845-abef-b690c3032e5d", "address": "fa:16:3e:ba:65:c3", "network": {"id": "b2f5648a-98cd-40dd-82d9-f8db04dc49e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1121012626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa85032ee2074843ab0c0a4d27947eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa05d138d-56", "ovs_interfaceid": "a05d138d-5697-4845-abef-b690c3032e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG os_vif [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa05d138d-56, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:36 user nova-compute[70375]: INFO os_vif [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:65:c3,bridge_name='br-int',has_traffic_filtering=True,id=a05d138d-5697-4845-abef-b690c3032e5d,network=Network(b2f5648a-98cd-40dd-82d9-f8db04dc49e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa05d138d-56')
Jul 24 18:03:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Deleting instance files /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b_del
Jul 24 18:03:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Deletion of /opt/stack/data/nova/instances/44bdf20e-8189-4fdf-8c00-3ff733fb357b_del complete
Jul 24 18:03:37 user nova-compute[70375]: INFO nova.compute.manager [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:37 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:37 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Took 0.92 seconds to deallocate network for instance.
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] Acquiring lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] No waiting events found dispatching network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:38 user nova-compute[70375]: WARNING nova.compute.manager [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received unexpected event network-vif-plugged-a05d138d-5697-4845-abef-b690c3032e5d for instance with vm_state deleted and task_state None.
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-7401ef6d-b3ff-405b-bbe5-9e01c2b8c639 req-4115223e-c077-4175-be1f-946e2144e4cd service nova] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Received event network-vif-deleted-a05d138d-5697-4845-abef-b690c3032e5d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.864s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:38 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Deleted allocations for instance 44bdf20e-8189-4fdf-8c00-3ff733fb357b
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:38 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-37583355-787c-4191-a1ca-eaf1352e750d tempest-ServerActionsV293TestJSON-1282122326 tempest-ServerActionsV293TestJSON-1282122326-project-member] Lock "44bdf20e-8189-4fdf-8c00-3ff733fb357b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.980s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=24.207714080810547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Applying migration context for instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f as it has an incoming, in-progress migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4. Migration status is finished {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 18:03:40 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating resource usage from migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance f45c7f1d-bb87-42a6-a988-97d80a96225b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 55e5e70a-02e5-4363-89b3-02cef5942015 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 7cc13769-301c-4bfc-a700-80d45282b6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:03:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:46 user nova-compute[70375]: INFO nova.compute.manager [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Terminating instance
Jul 24 18:03:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a7788106-0636-4cd9-8322-b7d01963e463 req-8466f882-9253-4563-9877-87eca0151c33 service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-unplugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:03:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Instance destroyed successfully.
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid f45c7f1d-bb87-42a6-a988-97d80a96225b {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1209451013',display_name='tempest-ServerRescueNegativeTestJSON-server-1209451013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1209451013',id=3,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-jk7mh80o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:49:35Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=f45c7f1d-bb87-42a6-a988-97d80a96225b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "ff87540f-1409-4b8e-a753-248a19b7836f", "address": "fa:16:3e:10:a3:54", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff87540f-14", "ovs_interfaceid": "ff87540f-1409-4b8e-a753-248a19b7836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG os_vif [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff87540f-14, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:47 user nova-compute[70375]: INFO os_vif [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:a3:54,bridge_name='br-int',has_traffic_filtering=True,id=ff87540f-1409-4b8e-a753-248a19b7836f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff87540f-14')
Jul 24 18:03:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Deleting instance files /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b_del
Jul 24 18:03:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Deletion of /opt/stack/data/nova/instances/f45c7f1d-bb87-42a6-a988-97d80a96225b_del complete
Jul 24 18:03:47 user nova-compute[70375]: INFO nova.compute.manager [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 18:03:47 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:03:47 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:03:48 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:48 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Took 0.76 seconds to deallocate network for instance.
Jul 24 18:03:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:48 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Deleted allocations for instance f45c7f1d-bb87-42a6-a988-97d80a96225b
Jul 24 18:03:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ed0200e2-7388-49bf-91ff-5883bf751b22 tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] Acquiring lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] Lock "f45c7f1d-bb87-42a6-a988-97d80a96225b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] No waiting events found dispatching network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:49 user nova-compute[70375]: WARNING nova.compute.manager [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received unexpected event network-vif-plugged-ff87540f-1409-4b8e-a753-248a19b7836f for instance with vm_state deleted and task_state None.
Jul 24 18:03:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-684fbab7-07ba-4ef1-9ebc-a9395d32296a req-c3966cc8-741a-4f3d-b205-0b5b1287502c service nova] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Received event network-vif-deleted-ff87540f-1409-4b8e-a753-248a19b7836f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:03:50 user nova-compute[70375]: INFO nova.compute.claims [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Claim successful on node user
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:03:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.policy [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c1aa740b7404c2e8703488bcd87404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a644d007b4ecdbde7ec4788464675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:03:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Creating image(s)
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "/opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk 1073741824" returned: 0 in 0.052s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Checking if we can resize image /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Successfully created port: ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221816.9426007, 44bdf20e-8189-4fdf-8c00-3ff733fb357b => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:51 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] VM Stopped (Lifecycle Event)
Jul 24 18:03:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-45a8b476-45dc-4068-b2ea-bfc3223a876a None None] [instance: 44bdf20e-8189-4fdf-8c00-3ff733fb357b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Cannot resize image /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'migration_context' on Instance uuid 184e5f1c-e463-4bd6-a9b0-f44a35748220 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Ensure instance console log exists: /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Successfully updated port: ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-changed-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Refreshing instance network info cache due to event network-changed-ed672e87-0cc7-44a2-8fe8-d79cb344d805. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] Acquiring lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:03:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updating instance_info_cache with network_info: [{"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Instance network_info: |[{"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] Acquired lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Refreshing network info cache for port ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Start _get_guest_xml network_info=[{"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:03:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:53 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132135910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132135910',id=31,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-8vbjfis5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:03:51Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=184e5f1c-e463-4bd6-a9b0-f44a35748220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid 184e5f1c-e463-4bd6-a9b0-f44a35748220 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:03:53 user nova-compute[70375]:   <uuid>184e5f1c-e463-4bd6-a9b0-f44a35748220</uuid>
Jul 24 18:03:53 user nova-compute[70375]:   <name>instance-0000001f</name>
Jul 24 18:03:53 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:03:53 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:03:53 user nova-compute[70375]:   <metadata>
Jul 24 18:03:53 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:03:53 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2132135910</nova:name>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:03:53</nova:creationTime>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:03:53 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:03:53 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:owner>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 18:03:53 user nova-compute[70375]:       </nova:owner>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:03:53 user nova-compute[70375]:       <nova:ports>
Jul 24 18:03:53 user nova-compute[70375]:         <nova:port uuid="ed672e87-0cc7-44a2-8fe8-d79cb344d805">
Jul 24 18:03:53 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 18:03:53 user nova-compute[70375]:         </nova:port>
Jul 24 18:03:53 user nova-compute[70375]:       </nova:ports>
Jul 24 18:03:53 user nova-compute[70375]:     </nova:instance>
Jul 24 18:03:53 user nova-compute[70375]:   </metadata>
Jul 24 18:03:53 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:03:53 user nova-compute[70375]:     <system>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="serial">184e5f1c-e463-4bd6-a9b0-f44a35748220</entry>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="uuid">184e5f1c-e463-4bd6-a9b0-f44a35748220</entry>
Jul 24 18:03:53 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:03:53 user nova-compute[70375]:     </system>
Jul 24 18:03:53 user nova-compute[70375]:   </sysinfo>
Jul 24 18:03:53 user nova-compute[70375]:   <os>
Jul 24 18:03:53 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:03:53 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:03:53 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:03:53 user nova-compute[70375]:   </os>
Jul 24 18:03:53 user nova-compute[70375]:   <features>
Jul 24 18:03:53 user nova-compute[70375]:     <acpi/>
Jul 24 18:03:53 user nova-compute[70375]:     <apic/>
Jul 24 18:03:53 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:03:53 user nova-compute[70375]:   </features>
Jul 24 18:03:53 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:03:53 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:03:53 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:03:53 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:03:53 user nova-compute[70375]:   </clock>
Jul 24 18:03:53 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:03:53 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:03:53 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:03:53 user nova-compute[70375]:   </cpu>
Jul 24 18:03:53 user nova-compute[70375]:   <devices>
Jul 24 18:03:53 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:03:53 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:03:53 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk"/>
Jul 24 18:03:53 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:03:53 user nova-compute[70375]:     </disk>
Jul 24 18:03:53 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:03:53 user nova-compute[70375]:       <mac address="fa:16:3e:a3:b1:c5"/>
Jul 24 18:03:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:53 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:03:53 user nova-compute[70375]:       <target dev="taped672e87-0c"/>
Jul 24 18:03:53 user nova-compute[70375]:     </interface>
Jul 24 18:03:53 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:03:53 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/console.log" append="off"/>
Jul 24 18:03:53 user nova-compute[70375]:     </serial>
Jul 24 18:03:53 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:03:53 user nova-compute[70375]:     <video>
Jul 24 18:03:53 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:03:53 user nova-compute[70375]:     </video>
Jul 24 18:03:53 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:03:53 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:03:53 user nova-compute[70375]:     </rng>
Jul 24 18:03:53 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:03:53 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:03:53 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:03:53 user nova-compute[70375]:     </memballoon>
Jul 24 18:03:53 user nova-compute[70375]:   </devices>
Jul 24 18:03:53 user nova-compute[70375]: </domain>
Jul 24 18:03:53 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132135910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132135910',id=31,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-8vbjfis5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:03:51Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=184e5f1c-e463-4bd6-a9b0-f44a35748220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG os_vif [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped672e87-0c, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped672e87-0c, col_values=(('external_ids', {'iface-id': 'ed672e87-0cc7-44a2-8fe8-d79cb344d805', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b1:c5', 'vm-uuid': '184e5f1c-e463-4bd6-a9b0-f44a35748220'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: INFO os_vif [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c')
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:a3:b1:c5, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:53 user nova-compute[70375]: INFO nova.compute.manager [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Terminating instance
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updated VIF entry in instance network info cache for port ed672e87-0cc7-44a2-8fe8-d79cb344d805. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updating instance_info_cache with network_info: [{"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0cee0485-13e5-4ece-9233-03deacc4fa15 req-09c2564d-5843-4901-8b72-afd5fd2955e8 service nova] Releasing lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-a75cdb73-8cf0-420e-bec6-2fe7f3e5dfb3 req-2a7b7123-4a87-46ab-812c-1188548035ee service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-unplugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:03:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Instance destroyed successfully.
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'resources' on Instance uuid 55e5e70a-02e5-4363-89b3-02cef5942015 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-737970939',display_name='tempest-TestMinimumBasicScenario-server-737970939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-737970939',id=27,image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN7FJ6XjYBO5yAcfiMri8WeXK0tEtqHYReyzegxCCpDbI0M7SkLFXtLSiVZr43A4/N79d6wVBstaWpmeL2vFdAvusebeeSXu/3HzHk23g7vE494HUwAgGO1o8U8tL2lRA==',key_name='tempest-TestMinimumBasicScenario-1119458332',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-o4gxfodj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='591c5d22-0f80-4b31-8e49-d57afcd9b746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:01:12Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=55e5e70a-02e5-4363-89b3-02cef5942015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "216d7d69-3422-4e84-8525-4494e06baa85", "address": "fa:16:3e:32:50:6c", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap216d7d69-34", "ovs_interfaceid": "216d7d69-3422-4e84-8525-4494e06baa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG os_vif [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap216d7d69-34, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:54 user nova-compute[70375]: INFO os_vif [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:50:6c,bridge_name='br-int',has_traffic_filtering=True,id=216d7d69-3422-4e84-8525-4494e06baa85,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216d7d69-34')
Jul 24 18:03:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Deleting instance files /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015_del
Jul 24 18:03:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Deletion of /opt/stack/data/nova/instances/55e5e70a-02e5-4363-89b3-02cef5942015_del complete
Jul 24 18:03:54 user nova-compute[70375]: INFO nova.compute.manager [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 24 18:03:54 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:03:54 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] No waiting events found dispatching network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:55 user nova-compute[70375]: WARNING nova.compute.manager [req-a72bb05b-21a4-471d-a761-2b70c82475fd req-96228b33-fa7a-4471-8e43-c2558015905d service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received unexpected event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 for instance with vm_state building and task_state spawning.
Jul 24 18:03:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:56 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Took 1.22 seconds to deallocate network for instance.
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-f4cc81d6-8087-40de-ab20-5f6017460ff0 req-cc72c6c2-cac9-4d97-a2da-21b3222feb14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-deleted-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:56 user nova-compute[70375]: INFO nova.compute.manager [req-f4cc81d6-8087-40de-ab20-5f6017460ff0 req-cc72c6c2-cac9-4d97-a2da-21b3222feb14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Neutron deleted interface 216d7d69-3422-4e84-8525-4494e06baa85; detaching it from the instance and deleting it from the info cache
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-f4cc81d6-8087-40de-ab20-5f6017460ff0 req-cc72c6c2-cac9-4d97-a2da-21b3222feb14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-f4cc81d6-8087-40de-ab20-5f6017460ff0 req-cc72c6c2-cac9-4d97-a2da-21b3222feb14 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Detach interface failed, port_id=216d7d69-3422-4e84-8525-4494e06baa85, reason: Instance 55e5e70a-02e5-4363-89b3-02cef5942015 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] Acquiring lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] Lock "55e5e70a-02e5-4363-89b3-02cef5942015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] No waiting events found dispatching network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:56 user nova-compute[70375]: WARNING nova.compute.manager [req-27edcdcf-b1c7-4f3e-9e09-48a5759f210c req-6582bd50-a87f-435a-8f6e-49eb1fedb2a4 service nova] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Received unexpected event network-vif-plugged-216d7d69-3422-4e84-8525-4494e06baa85 for instance with vm_state deleted and task_state None.
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:56 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Deleted allocations for instance 55e5e70a-02e5-4363-89b3-02cef5942015
Jul 24 18:03:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ce3784df-ab3c-4d61-8bab-5335d6c8450e tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "55e5e70a-02e5-4363-89b3-02cef5942015" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221837.3035452, 184e5f1c-e463-4bd6-a9b0-f44a35748220 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] VM Resumed (Lifecycle Event)
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Instance spawned successfully.
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221837.3046489, 184e5f1c-e463-4bd6-a9b0-f44a35748220 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] VM Started (Lifecycle Event)
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Took 6.08 seconds to spawn the instance on the hypervisor.
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:03:57 user nova-compute[70375]: INFO nova.compute.manager [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Took 6.83 seconds to build instance.
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] No waiting events found dispatching network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:03:57 user nova-compute[70375]: WARNING nova.compute.manager [req-7ffad46c-3430-44bf-b636-2a1473ade268 req-6dc9bcb7-f684-42e1-afbc-2c84cd23c4d8 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received unexpected event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 for instance with vm_state active and task_state None.
Jul 24 18:03:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a379b0dc-e467-4690-9222-c980f135b2d6 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:03:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:03:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:02 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221827.3102224, f45c7f1d-bb87-42a6-a988-97d80a96225b => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:02 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] VM Stopped (Lifecycle Event)
Jul 24 18:04:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b40a1746-3dc5-420d-b9c0-637eaefd2851 None None] [instance: f45c7f1d-bb87-42a6-a988-97d80a96225b] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:09 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221834.7568562, 55e5e70a-02e5-4363-89b3-02cef5942015 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:09 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] VM Stopped (Lifecycle Event)
Jul 24 18:04:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-193444d6-2f86-4fa1-be29-925c9676efa1 None None] [instance: 55e5e70a-02e5-4363-89b3-02cef5942015] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:12 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:04:12 user nova-compute[70375]: INFO nova.compute.claims [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Claim successful on node user
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:13 user nova-compute[70375]: WARNING nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 7cc13769-301c-4bfc-a700-80d45282b6e7 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 184e5f1c-e463-4bd6-a9b0-f44a35748220 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:04:13 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:04:13 user nova-compute[70375]: INFO nova.virt.block_device [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Booting with volume snapshot 096f0f49-75a9-4feb-bb48-d749ed264b25 at /dev/vda
Jul 24 18:04:13 user nova-compute[70375]: DEBUG nova.policy [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:04:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Successfully created port: f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Successfully updated port: f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-changed-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.compute.manager [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Refreshing instance network info cache due to event network-changed-f46866f7-adba-4144-a79f-745e9c3ee0dd. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] Acquiring lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:14 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Updating instance_info_cache with network_info: [{"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Instance network_info: |[{"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] Acquired lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Refreshing network info cache for port f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Updated VIF entry in instance network info cache for port f46866f7-adba-4144-a79f-745e9c3ee0dd. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG nova.network.neutron [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Updating instance_info_cache with network_info: [{"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d0ecb0ba-1198-424f-b684-a66598ebb853 req-d1ac0594-7bd4-4cce-b780-b2c7ccb8d078 service nova] Releasing lock "refresh_cache-29bcdf8a-0fac-4759-a9c2-eaa427f643d6" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG os_brick.utils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c7f0f-ca72-4f8b-938b-d0f9926e5d31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[75af896b-7c83-4d99-a78f-9093f478e52e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc6416-d8aa-4c96-8f86-fa0a19dcdc35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[35419c9b-1ab2-4d22-825c-cc1868ce6419]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:04:19 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:04:19 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b4d085-37c3-4884-9a02-3f5739f05ee0]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG os_brick.utils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Updating existing volume attachment record: e18fad69-2629-487b-80c0-f5b8490fc38c {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:04:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:04:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Creating image(s)
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Ensure instance console log exists: /opt/stack/data/nova/instances/29bcdf8a-0fac-4759-a9c2-eaa427f643d6/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Start _get_guest_xml network_info=[{"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e18fad69-2629-487b-80c0-f5b8490fc38c', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcWlKYVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29bcdf8a-0fac-4759-a9c2-eaa427f643d6', 'attached_at': '', 'detached_at': '', 'volume_id': '4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 'serial': '4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:04:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:25 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcWlKYVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:04:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:04:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:04:25 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee368a79-b023-40b8-9842-614e1edfe394]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:04:25 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e990e0-78f1-499e-83d1-9dacf500026b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f] added
Jul 24 18:04:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631170b-896b-4490-8b2d-fbcb45e7a434]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7a016-cf63-4ab7-9894-3cb9688d70cf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcWlKYVC {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcWlKYVC" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16b65fc-68db-446b-8b38-954f65c22993]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OcWlKYVC'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc7325-1987-457e-9b28-ceb46c1ed173]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae09511-f37a-4e8c-9c13-bcbe2f75a435]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:04:25 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:04:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:04:25 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:04:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:04:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec274358-6c0a-449d-a521-02c0278acdb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260]
Jul 24 18:04:26 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260] successful.
Jul 24 18:04:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ead1a5-5769-47ee-a709-30eab864eaea]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f16b3e-5c8c-49c8-aebf-6ffe8d4c9b3e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:04:26 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:04:26 user nova-compute[70375]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)
Jul 24 18:04:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:04:26 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:04:26 user nova-compute[70375]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)
Jul 24 18:04:26 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df6a8d-6cd9-4384-98a9-2af27e800d8f]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcWlKYVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:04:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23438643733393031', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438643733393031', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1983989265',display_name='tempest-TestVolumeBootPattern-server-1983989265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1983989265',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-tx79ao2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:13Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=29bcdf8a-0fac-4759-a9c2-eaa427f643d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:04:27 user nova-compute[70375]:   <uuid>29bcdf8a-0fac-4759-a9c2-eaa427f643d6</uuid>
Jul 24 18:04:27 user nova-compute[70375]:   <name>instance-00000020</name>
Jul 24 18:04:27 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:04:27 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:04:27 user nova-compute[70375]:   <metadata>
Jul 24 18:04:27 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:04:27 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:04:27 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-server-1983989265</nova:name>
Jul 24 18:04:27 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:04:25</nova:creationTime>
Jul 24 18:04:27 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:04:27 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:04:27 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:04:27 user nova-compute[70375]:       <nova:owner>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:04:27 user nova-compute[70375]:       </nova:owner>
Jul 24 18:04:27 user nova-compute[70375]:       <nova:ports>
Jul 24 18:04:27 user nova-compute[70375]:         <nova:port uuid="f46866f7-adba-4144-a79f-745e9c3ee0dd">
Jul 24 18:04:27 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 18:04:27 user nova-compute[70375]:         </nova:port>
Jul 24 18:04:27 user nova-compute[70375]:       </nova:ports>
Jul 24 18:04:27 user nova-compute[70375]:     </nova:instance>
Jul 24 18:04:27 user nova-compute[70375]:   </metadata>
Jul 24 18:04:27 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:04:27 user nova-compute[70375]:     <system>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="serial">29bcdf8a-0fac-4759-a9c2-eaa427f643d6</entry>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="uuid">29bcdf8a-0fac-4759-a9c2-eaa427f643d6</entry>
Jul 24 18:04:27 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:04:27 user nova-compute[70375]:     </system>
Jul 24 18:04:27 user nova-compute[70375]:   </sysinfo>
Jul 24 18:04:27 user nova-compute[70375]:   <os>
Jul 24 18:04:27 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:04:27 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:04:27 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:04:27 user nova-compute[70375]:   </os>
Jul 24 18:04:27 user nova-compute[70375]:   <features>
Jul 24 18:04:27 user nova-compute[70375]:     <acpi/>
Jul 24 18:04:27 user nova-compute[70375]:     <apic/>
Jul 24 18:04:27 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:04:27 user nova-compute[70375]:   </features>
Jul 24 18:04:27 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:04:27 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:04:27 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:04:27 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:04:27 user nova-compute[70375]:   </clock>
Jul 24 18:04:27 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:04:27 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:04:27 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:04:27 user nova-compute[70375]:   </cpu>
Jul 24 18:04:27 user nova-compute[70375]:   <devices>
Jul 24 18:04:27 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:04:27 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:04:27 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 18:04:27 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:04:27 user nova-compute[70375]:       <serial>4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f</serial>
Jul 24 18:04:27 user nova-compute[70375]:     </disk>
Jul 24 18:04:27 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:04:27 user nova-compute[70375]:       <mac address="fa:16:3e:46:b0:8a"/>
Jul 24 18:04:27 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:27 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:04:27 user nova-compute[70375]:       <target dev="tapf46866f7-ad"/>
Jul 24 18:04:27 user nova-compute[70375]:     </interface>
Jul 24 18:04:27 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:04:27 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/29bcdf8a-0fac-4759-a9c2-eaa427f643d6/console.log" append="off"/>
Jul 24 18:04:27 user nova-compute[70375]:     </serial>
Jul 24 18:04:27 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:04:27 user nova-compute[70375]:     <video>
Jul 24 18:04:27 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:27 user nova-compute[70375]:     </video>
Jul 24 18:04:27 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:04:27 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:04:27 user nova-compute[70375]:     </rng>
Jul 24 18:04:27 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:04:27 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:04:27 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:04:27 user nova-compute[70375]:     </memballoon>
Jul 24 18:04:27 user nova-compute[70375]:   </devices>
Jul 24 18:04:27 user nova-compute[70375]: </domain>
Jul 24 18:04:27 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1983989265',display_name='tempest-TestVolumeBootPattern-server-1983989265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1983989265',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-tx79ao2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:13Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=29bcdf8a-0fac-4759-a9c2-eaa427f643d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG os_vif [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf46866f7-ad, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf46866f7-ad, col_values=(('external_ids', {'iface-id': 'f46866f7-adba-4144-a79f-745e9c3ee0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:b0:8a', 'vm-uuid': '29bcdf8a-0fac-4759-a9c2-eaa427f643d6'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:27 user nova-compute[70375]: INFO os_vif [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad')
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:04:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:46:b0:8a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:28 user nova-compute[70375]: WARNING nova.compute.manager [req-7704eccb-1ba4-47ca-a2a3-2a67a2c360d4 req-e36ef50f-2638-4c9d-acbf-668cb92509c3 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state building and task_state spawning.
Jul 24 18:04:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:04:29 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221870.606561, 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] VM Resumed (Lifecycle Event)
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Instance spawned successfully.
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221870.6113186, 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] VM Started (Lifecycle Event)
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Took 5.01 seconds to spawn the instance on the hypervisor.
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:30 user nova-compute[70375]: WARNING nova.compute.manager [req-316a0c6f-2cda-4e5c-9806-ef23f2837d7f req-f31800b4-4dfe-4c5c-9df9-d1b516250c4f service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state building and task_state spawning.
Jul 24 18:04:30 user nova-compute[70375]: INFO nova.compute.manager [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Took 18.10 seconds to build instance.
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c29ef64f-8655-4016-8c50-9b3fbf91b2cf tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.185s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.698s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:04:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: INFO nova.compute.manager [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Terminating instance
Jul 24 18:04:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Instance destroyed successfully.
Jul 24 18:04:37 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lazy-loading 'resources' on Instance uuid be9aa713-99fd-4e4a-a5bb-50f30de8b7ae {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1968919247',display_name='tempest-ServerRescueNegativeTestJSON-server-1968919247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1968919247',id=2,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2983b563c19040dfbec3b2c10ce2d14e',ramdisk_id='',reservation_id='r-teimgbjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-858879732',owner_user_name='tempest-ServerRescueNegativeTestJSON-858879732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:54:17Z,user_data=None,user_id='51a4f4aec1664e07b1d57a7848c02498',uuid=be9aa713-99fd-4e4a-a5bb-50f30de8b7ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converting VIF {"id": "0e8525b5-b749-40ef-a718-06cb77902a2f", "address": "fa:16:3e:6e:aa:fc", "network": {"id": "40fd516f-7069-46c4-aced-7e1a2bb4672b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1834816204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2983b563c19040dfbec3b2c10ce2d14e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8525b5-b7", "ovs_interfaceid": "0e8525b5-b749-40ef-a718-06cb77902a2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG os_vif [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e8525b5-b7, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:04:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:37 user nova-compute[70375]: INFO os_vif [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:aa:fc,bridge_name='br-int',has_traffic_filtering=True,id=0e8525b5-b749-40ef-a718-06cb77902a2f,network=Network(40fd516f-7069-46c4-aced-7e1a2bb4672b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8525b5-b7')
Jul 24 18:04:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Deleting instance files /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae_del
Jul 24 18:04:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Deletion of /opt/stack/data/nova/instances/be9aa713-99fd-4e4a-a5bb-50f30de8b7ae_del complete
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-2eb6a4d4-6f12-4a45-8267-fc351c6aa767 req-dfbd387e-30d5-44ba-8458-39330a766245 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-unplugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:04:38 user nova-compute[70375]: INFO nova.compute.manager [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:38 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Took 0.63 seconds to deallocate network for instance.
Jul 24 18:04:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-88656787-cf09-421f-b602-2e478b4a2b12 req-e1b482b9-80fb-4004-8e46-a025f2f84661 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-deleted-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:39 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Deleted allocations for instance be9aa713-99fd-4e4a-a5bb-50f30de8b7ae
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2169a4ce-ebb2-441f-8de2-06731783db6d tempest-ServerRescueNegativeTestJSON-858879732 tempest-ServerRescueNegativeTestJSON-858879732-project-member] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:04:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] Acquiring lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] Lock "be9aa713-99fd-4e4a-a5bb-50f30de8b7ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] No waiting events found dispatching network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:40 user nova-compute[70375]: WARNING nova.compute.manager [req-241ec4d4-bf84-4a4b-ae6f-95812588fecd req-0bfb84a4-af8c-4c4d-a57d-cbee6633fba8 service nova] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Received unexpected event network-vif-plugged-0e8525b5-b749-40ef-a718-06cb77902a2f for instance with vm_state deleted and task_state None.
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:41 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:41 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=24.241046905517578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Applying migration context for instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f as it has an incoming, in-progress migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4. Migration status is finished {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 18:04:41 user nova-compute[70375]: INFO nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating resource usage from migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 7cc13769-301c-4bfc-a700-80d45282b6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.312s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:04:41 user nova-compute[70375]: INFO nova.compute.claims [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Claim successful on node user
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:04:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:04:41 user nova-compute[70375]: DEBUG nova.policy [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db18ae70ad59494e9f4c13b122f3ecc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324c7b2c403942d28dfe43d9f6f30644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:04:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Creating image(s)
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk 1073741824" returned: 0 in 0.062s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Cannot resize image /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'migration_context' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Successfully created port: 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Ensure instance console log exists: /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Successfully updated port: 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing instance network info cache due to event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance network_info: |[{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.neutron [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start _get_guest_xml network_info=[{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:04:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:43 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-882395697',display_name='tempest-ServerStableDeviceRescueTest-server-882395697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-882395697',id=33,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcHuHcfaaRB4/AQqnwNqOcQ1K1vm1m9o5CGpOYaaMJiDo+g+pkj8AyLaOZlGLvExJaEKDWMED4Uuzw5Rlil4qLOlJ/kHFW+SSE+GvyqLIIPvv2EqS+jEU0MMOyHbe5t+w==',key_name='tempest-keypair-138371338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324c7b2c403942d28dfe43d9f6f30644',ramdisk_id='',reservation_id='r-atgmp2n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1383704498',owner_user_name='tempest-ServerStableDeviceRescueTest-1383704498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db18ae70ad59494e9f4c13b122f3ecc9',uuid=38b4d478-958e-4355-907d-884f43f9f799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converting VIF {"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'pci_devices' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:04:43 user nova-compute[70375]:   <uuid>38b4d478-958e-4355-907d-884f43f9f799</uuid>
Jul 24 18:04:43 user nova-compute[70375]:   <name>instance-00000021</name>
Jul 24 18:04:43 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:04:43 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:04:43 user nova-compute[70375]:   <metadata>
Jul 24 18:04:43 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:04:43 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-882395697</nova:name>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:04:43</nova:creationTime>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:04:43 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:04:43 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:owner>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:user uuid="db18ae70ad59494e9f4c13b122f3ecc9">tempest-ServerStableDeviceRescueTest-1383704498-project-member</nova:user>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:project uuid="324c7b2c403942d28dfe43d9f6f30644">tempest-ServerStableDeviceRescueTest-1383704498</nova:project>
Jul 24 18:04:43 user nova-compute[70375]:       </nova:owner>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:04:43 user nova-compute[70375]:       <nova:ports>
Jul 24 18:04:43 user nova-compute[70375]:         <nova:port uuid="6f0e720f-2f21-413e-ba70-1f1d7581d414">
Jul 24 18:04:43 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 18:04:43 user nova-compute[70375]:         </nova:port>
Jul 24 18:04:43 user nova-compute[70375]:       </nova:ports>
Jul 24 18:04:43 user nova-compute[70375]:     </nova:instance>
Jul 24 18:04:43 user nova-compute[70375]:   </metadata>
Jul 24 18:04:43 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:04:43 user nova-compute[70375]:     <system>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="serial">38b4d478-958e-4355-907d-884f43f9f799</entry>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="uuid">38b4d478-958e-4355-907d-884f43f9f799</entry>
Jul 24 18:04:43 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:04:43 user nova-compute[70375]:     </system>
Jul 24 18:04:43 user nova-compute[70375]:   </sysinfo>
Jul 24 18:04:43 user nova-compute[70375]:   <os>
Jul 24 18:04:43 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:04:43 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:04:43 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:04:43 user nova-compute[70375]:   </os>
Jul 24 18:04:43 user nova-compute[70375]:   <features>
Jul 24 18:04:43 user nova-compute[70375]:     <acpi/>
Jul 24 18:04:43 user nova-compute[70375]:     <apic/>
Jul 24 18:04:43 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:04:43 user nova-compute[70375]:   </features>
Jul 24 18:04:43 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:04:43 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:04:43 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:04:43 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:04:43 user nova-compute[70375]:   </clock>
Jul 24 18:04:43 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:04:43 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:04:43 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:04:43 user nova-compute[70375]:   </cpu>
Jul 24 18:04:43 user nova-compute[70375]:   <devices>
Jul 24 18:04:43 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:04:43 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:04:43 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk"/>
Jul 24 18:04:43 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:04:43 user nova-compute[70375]:     </disk>
Jul 24 18:04:43 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:04:43 user nova-compute[70375]:       <mac address="fa:16:3e:77:92:e7"/>
Jul 24 18:04:43 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:43 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:04:43 user nova-compute[70375]:       <target dev="tap6f0e720f-2f"/>
Jul 24 18:04:43 user nova-compute[70375]:     </interface>
Jul 24 18:04:43 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:04:43 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/console.log" append="off"/>
Jul 24 18:04:43 user nova-compute[70375]:     </serial>
Jul 24 18:04:43 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:04:43 user nova-compute[70375]:     <video>
Jul 24 18:04:43 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:43 user nova-compute[70375]:     </video>
Jul 24 18:04:43 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:04:43 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:04:43 user nova-compute[70375]:     </rng>
Jul 24 18:04:43 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:04:43 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:04:43 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:04:43 user nova-compute[70375]:     </memballoon>
Jul 24 18:04:43 user nova-compute[70375]:   </devices>
Jul 24 18:04:43 user nova-compute[70375]: </domain>
Jul 24 18:04:43 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-882395697',display_name='tempest-ServerStableDeviceRescueTest-server-882395697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-882395697',id=33,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcHuHcfaaRB4/AQqnwNqOcQ1K1vm1m9o5CGpOYaaMJiDo+g+pkj8AyLaOZlGLvExJaEKDWMED4Uuzw5Rlil4qLOlJ/kHFW+SSE+GvyqLIIPvv2EqS+jEU0MMOyHbe5t+w==',key_name='tempest-keypair-138371338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324c7b2c403942d28dfe43d9f6f30644',ramdisk_id='',reservation_id='r-atgmp2n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1383704498',owner_user_name='tempest-ServerStableDeviceRescueTest-1383704498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db18ae70ad59494e9f4c13b122f3ecc9',uuid=38b4d478-958e-4355-907d-884f43f9f799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converting VIF {"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG os_vif [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f0e720f-2f, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f0e720f-2f, col_values=(('external_ids', {'iface-id': '6f0e720f-2f21-413e-ba70-1f1d7581d414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:92:e7', 'vm-uuid': '38b4d478-958e-4355-907d-884f43f9f799'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:04:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:43 user nova-compute[70375]: INFO os_vif [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f')
Jul 24 18:04:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:04:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No VIF found with MAC fa:16:3e:77:92:e7, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:04:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updated VIF entry in instance network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:04:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8d509b40-7c07-4460-b9ba-ed700725dfcb req-f64dd2e5-065e-4e36-9ea4-4d6f70191395 service nova] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:45 user nova-compute[70375]: WARNING nova.compute.manager [req-d7ead7b8-ed14-4906-9f88-95149f3105d3 req-54d25fbb-0f01-409b-8c2e-0ed54ecc463e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state building and task_state spawning.
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221887.5374904, 38b4d478-958e-4355-907d-884f43f9f799 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Resumed (Lifecycle Event)
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance spawned successfully.
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221887.5416923, 38b4d478-958e-4355-907d-884f43f9f799 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Started (Lifecycle Event)
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:47 user nova-compute[70375]: WARNING nova.compute.manager [req-8b9edf7b-70a1-4929-8312-ce09b520569c req-5d497ba1-8607-4197-a87b-8993bae7690f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state building and task_state spawning.
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Took 5.64 seconds to spawn the instance on the hypervisor.
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:47 user nova-compute[70375]: INFO nova.compute.manager [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Took 6.65 seconds to build instance.
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-956cdff8-7795-4d2e-a8e8-f2181532533f tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.753s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:04:48 user nova-compute[70375]: INFO nova.compute.claims [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Claim successful on node user
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Going to confirm migration 2 {{(pid=70375) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquired lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'info_cache' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:04:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.policy [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c5063436895467ca5ffae12856a1677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a342f080683d45b29897f8bf407de037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:04:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Creating image(s)
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "/opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "/opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.part --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG nova.virt.images [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] 6b51bdd0-60f5-4cf2-af13-41837431b960 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.part /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [{"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Releasing lock "refresh_cache-8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'migration_context' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.part /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.converted" returned: 0 in 0.278s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Successfully created port: 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.151s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json" returned: 0 in 0.174s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json" returned: 0 in 0.158s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde,backing_fmt=raw /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde,backing_fmt=raw /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk 1073741824" returned: 0 in 0.051s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "145fe3372f05fa0a2065501a6741e55bd2f55fde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde --force-share --output=json" returned: 0 in 0.253s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.974s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Cannot resize image /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.objects.instance [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'migration_context' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Ensure instance console log exists: /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Successfully updated port: 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing instance network info cache due to event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:04:50 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:04:50 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Deleted allocation for migration 54a1d656-2a17-4bbf-a46c-b730b991a6d4
Jul 24 18:04:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-be4736b9-85c0-4c9b-a817-d963fe1e2cf8 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.794s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.neutron [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance network_info: |[{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Start _get_guest_xml network_info=[{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T18:04:45Z,direct_url=<?>,disk_format='qcow2',id=6b51bdd0-60f5-4cf2-af13-41837431b960,min_disk=0,min_ram=0,name='tempest-scenario-img--1817993642',owner='a342f080683d45b29897f8bf407de037',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T18:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '6b51bdd0-60f5-4cf2-af13-41837431b960'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:04:51 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:51 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T18:04:45Z,direct_url=<?>,disk_format='qcow2',id=6b51bdd0-60f5-4cf2-af13-41837431b960,min_disk=0,min_ram=0,name='tempest-scenario-img--1817993642',owner='a342f080683d45b29897f8bf407de037',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T18:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-563369589',display_name='tempest-TestMinimumBasicScenario-server-563369589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-563369589',id=34,image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoR8yRp0rQf2sIeTezTZ1YFyFl1bTJBD/PS8eN26fMj9Ms49Hoo7HFqmkwHazjmjjv3va/SdMqAx2CjCFLlasnnxRpyDTF0i6IOdgNSuttOqeZtVm/tp4puiPNSo6g7LA==',key_name='tempest-TestMinimumBasicScenario-1482626662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-mb4g543g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:49Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=8a10387a-c571-4b26-bbbf-8b86b12ffcc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:04:51 user nova-compute[70375]:   <uuid>8a10387a-c571-4b26-bbbf-8b86b12ffcc1</uuid>
Jul 24 18:04:51 user nova-compute[70375]:   <name>instance-00000022</name>
Jul 24 18:04:51 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:04:51 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:04:51 user nova-compute[70375]:   <metadata>
Jul 24 18:04:51 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:04:51 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:name>tempest-TestMinimumBasicScenario-server-563369589</nova:name>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:04:51</nova:creationTime>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:04:51 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:04:51 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:owner>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:user uuid="2c5063436895467ca5ffae12856a1677">tempest-TestMinimumBasicScenario-1073066154-project-member</nova:user>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:project uuid="a342f080683d45b29897f8bf407de037">tempest-TestMinimumBasicScenario-1073066154</nova:project>
Jul 24 18:04:51 user nova-compute[70375]:       </nova:owner>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:root type="image" uuid="6b51bdd0-60f5-4cf2-af13-41837431b960"/>
Jul 24 18:04:51 user nova-compute[70375]:       <nova:ports>
Jul 24 18:04:51 user nova-compute[70375]:         <nova:port uuid="7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d">
Jul 24 18:04:51 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 18:04:51 user nova-compute[70375]:         </nova:port>
Jul 24 18:04:51 user nova-compute[70375]:       </nova:ports>
Jul 24 18:04:51 user nova-compute[70375]:     </nova:instance>
Jul 24 18:04:51 user nova-compute[70375]:   </metadata>
Jul 24 18:04:51 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:04:51 user nova-compute[70375]:     <system>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="serial">8a10387a-c571-4b26-bbbf-8b86b12ffcc1</entry>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="uuid">8a10387a-c571-4b26-bbbf-8b86b12ffcc1</entry>
Jul 24 18:04:51 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:04:51 user nova-compute[70375]:     </system>
Jul 24 18:04:51 user nova-compute[70375]:   </sysinfo>
Jul 24 18:04:51 user nova-compute[70375]:   <os>
Jul 24 18:04:51 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:04:51 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:04:51 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:04:51 user nova-compute[70375]:   </os>
Jul 24 18:04:51 user nova-compute[70375]:   <features>
Jul 24 18:04:51 user nova-compute[70375]:     <acpi/>
Jul 24 18:04:51 user nova-compute[70375]:     <apic/>
Jul 24 18:04:51 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:04:51 user nova-compute[70375]:   </features>
Jul 24 18:04:51 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:04:51 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:04:51 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:04:51 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:04:51 user nova-compute[70375]:   </clock>
Jul 24 18:04:51 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:04:51 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:04:51 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:04:51 user nova-compute[70375]:   </cpu>
Jul 24 18:04:51 user nova-compute[70375]:   <devices>
Jul 24 18:04:51 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:04:51 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:04:51 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk"/>
Jul 24 18:04:51 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:04:51 user nova-compute[70375]:     </disk>
Jul 24 18:04:51 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:04:51 user nova-compute[70375]:       <mac address="fa:16:3e:1e:30:2b"/>
Jul 24 18:04:51 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:51 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:04:51 user nova-compute[70375]:       <target dev="tap7cfc7bcd-35"/>
Jul 24 18:04:51 user nova-compute[70375]:     </interface>
Jul 24 18:04:51 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:04:51 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/console.log" append="off"/>
Jul 24 18:04:51 user nova-compute[70375]:     </serial>
Jul 24 18:04:51 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:04:51 user nova-compute[70375]:     <video>
Jul 24 18:04:51 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:04:51 user nova-compute[70375]:     </video>
Jul 24 18:04:51 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:04:51 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:04:51 user nova-compute[70375]:     </rng>
Jul 24 18:04:51 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:04:51 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:04:51 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:04:51 user nova-compute[70375]:     </memballoon>
Jul 24 18:04:51 user nova-compute[70375]:   </devices>
Jul 24 18:04:51 user nova-compute[70375]: </domain>
Jul 24 18:04:51 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-563369589',display_name='tempest-TestMinimumBasicScenario-server-563369589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-563369589',id=34,image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoR8yRp0rQf2sIeTezTZ1YFyFl1bTJBD/PS8eN26fMj9Ms49Hoo7HFqmkwHazjmjjv3va/SdMqAx2CjCFLlasnnxRpyDTF0i6IOdgNSuttOqeZtVm/tp4puiPNSo6g7LA==',key_name='tempest-TestMinimumBasicScenario-1482626662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-mb4g543g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:04:49Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=8a10387a-c571-4b26-bbbf-8b86b12ffcc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG os_vif [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cfc7bcd-35, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cfc7bcd-35, col_values=(('external_ids', {'iface-id': '7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:30:2b', 'vm-uuid': '8a10387a-c571-4b26-bbbf-8b86b12ffcc1'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:51 user nova-compute[70375]: INFO os_vif [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35')
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No VIF found with MAC fa:16:3e:1e:30:2b, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updated VIF entry in instance network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG nova.network.neutron [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:04:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c7be4324-e1c8-4ee2-9853-38c013babaa4 req-feec075b-d0eb-4884-8daf-8bba6c74c081 service nova] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:04:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:52 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221877.930018, be9aa713-99fd-4e4a-a5bb-50f30de8b7ae => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:52 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] VM Stopped (Lifecycle Event)
Jul 24 18:04:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6792ab47-4340-4aef-851f-1baa036ea178 None None] [instance: be9aa713-99fd-4e4a-a5bb-50f30de8b7ae] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:53 user nova-compute[70375]: WARNING nova.compute.manager [req-cc12577f-d70c-4b42-98d0-cab2e6045f84 req-c5a3e535-e986-41d9-84c0-5a38c4aa438d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state building and task_state spawning.
Jul 24 18:04:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:04:55 user nova-compute[70375]: WARNING nova.compute.manager [req-79d9c1b4-4623-4d8a-a871-ca8d9f8795b4 req-3e6c0b31-ab13-4497-9bfd-820e3221715d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state building and task_state spawning.
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221895.4919865, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] VM Resumed (Lifecycle Event)
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance spawned successfully.
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221895.4933782, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] VM Started (Lifecycle Event)
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Took 6.91 seconds to spawn the instance on the hypervisor.
Jul 24 18:04:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:04:55 user nova-compute[70375]: INFO nova.compute.manager [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Took 7.72 seconds to build instance.
Jul 24 18:04:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-21eb3bf8-27f6-4424-806a-a652a7e00f30 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.924s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:04:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:04:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:05 user nova-compute[70375]: INFO nova.compute.manager [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Terminating instance
Jul 24 18:05:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-unplugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] No waiting events found dispatching network-vif-unplugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-e410916e-a4da-4a47-89de-15da515f15c7 req-103c19f1-ab06-40a4-a6f3-1ab62115f53e service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-unplugged-2c7f5a8f-77f5-4d67-a151-52e576043101 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Instance destroyed successfully.
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lazy-loading 'resources' on Instance uuid 7cc13769-301c-4bfc-a700-80d45282b6e7 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-880323083',display_name='tempest-VolumesNegativeTest-instance-880323083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-880323083',id=30,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ee82f625b7940668757a85524cb553f',ramdisk_id='',reservation_id='r-5b72jrvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2087521434',owner_user_name='tempest-VolumesNegativeTest-2087521434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:03:22Z,user_data=None,user_id='1fe174981b81427cbbc6fbb54f25a276',uuid=7cc13769-301c-4bfc-a700-80d45282b6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converting VIF {"id": "2c7f5a8f-77f5-4d67-a151-52e576043101", "address": "fa:16:3e:d7:f2:84", "network": {"id": "06dca79c-ce54-4bd7-96fb-2bc465b72dcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1e181dcf731f4b52a8e3e21f80c1b37d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7f5a8f-77", "ovs_interfaceid": "2c7f5a8f-77f5-4d67-a151-52e576043101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG os_vif [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c7f5a8f-77, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:05:06 user nova-compute[70375]: INFO os_vif [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:84,bridge_name='br-int',has_traffic_filtering=True,id=2c7f5a8f-77f5-4d67-a151-52e576043101,network=Network(06dca79c-ce54-4bd7-96fb-2bc465b72dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7f5a8f-77')
Jul 24 18:05:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Deleting instance files /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7_del
Jul 24 18:05:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Deletion of /opt/stack/data/nova/instances/7cc13769-301c-4bfc-a700-80d45282b6e7_del complete
Jul 24 18:05:06 user nova-compute[70375]: INFO nova.compute.manager [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 18:05:06 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:05:06 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:05:07 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:05:07 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Took 0.51 seconds to deallocate network for instance.
Jul 24 18:05:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:07 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:05:07 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:05:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:07 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Deleted allocations for instance 7cc13769-301c-4bfc-a700-80d45282b6e7
Jul 24 18:05:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a4b3b880-a0bd-408b-89b4-40f31f76503b tempest-VolumesNegativeTest-2087521434 tempest-VolumesNegativeTest-2087521434-project-member] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.823s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] Acquiring lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] Lock "7cc13769-301c-4bfc-a700-80d45282b6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] No waiting events found dispatching network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:05:08 user nova-compute[70375]: WARNING nova.compute.manager [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received unexpected event network-vif-plugged-2c7f5a8f-77f5-4d67-a151-52e576043101 for instance with vm_state deleted and task_state None.
Jul 24 18:05:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-5229ab9a-2831-43dd-b0d4-e624824e6e67 req-6eebbcec-0666-40ed-a8c7-a7df5dd6ba27 service nova] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Received event network-vif-deleted-2c7f5a8f-77f5-4d67-a151-52e576043101 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:21 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221906.5185857, 7cc13769-301c-4bfc-a700-80d45282b6e7 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:05:21 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] VM Stopped (Lifecycle Event)
Jul 24 18:05:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b3f1d6f4-0034-4929-9a09-16193c61edc1 None None] [instance: 7cc13769-301c-4bfc-a700-80d45282b6e7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:05:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:05:32 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [{"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-9228b8cf-e00a-4a57-9762-3e9063199d63" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:05:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:05:39 user nova-compute[70375]: INFO nova.compute.claims [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Claim successful on node user
Jul 24 18:05:39 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:05:39 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:05:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.policy [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54ed6f06c3524fae8e6dcd4514c97fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0efa461cc94bd594ad5e72f98d11f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:05:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Creating image(s)
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "/opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "/opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk 1073741824" returned: 0 in 0.047s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Successfully created port: cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Cannot resize image /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'migration_context' on Instance uuid b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Ensure instance console log exists: /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Successfully updated port: cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquired lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-changed-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Refreshing instance network info cache due to event network-changed-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] Acquiring lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:05:41 user nova-compute[70375]: INFO nova.compute.manager [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] instance snapshotting
Jul 24 18:05:41 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Beginning live snapshot process
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updating instance_info_cache with network_info: [{"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Releasing lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Instance network_info: |[{"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] Acquired lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Refreshing network info cache for port cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Start _get_guest_xml network_info=[{"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:05:42 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:05:42 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1513166301',display_name='tempest-ServersNegativeTestJSON-server-1513166301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1513166301',id=35,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-z4hj71s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:05:40Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'pci_devices' on Instance uuid b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:05:42 user nova-compute[70375]:   <uuid>b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3</uuid>
Jul 24 18:05:42 user nova-compute[70375]:   <name>instance-00000023</name>
Jul 24 18:05:42 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:05:42 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:05:42 user nova-compute[70375]:   <metadata>
Jul 24 18:05:42 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:05:42 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:name>tempest-ServersNegativeTestJSON-server-1513166301</nova:name>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:05:42</nova:creationTime>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:05:42 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:05:42 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:owner>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:user uuid="54ed6f06c3524fae8e6dcd4514c97fad">tempest-ServersNegativeTestJSON-750541146-project-member</nova:user>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:project uuid="4d0efa461cc94bd594ad5e72f98d11f9">tempest-ServersNegativeTestJSON-750541146</nova:project>
Jul 24 18:05:42 user nova-compute[70375]:       </nova:owner>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:05:42 user nova-compute[70375]:       <nova:ports>
Jul 24 18:05:42 user nova-compute[70375]:         <nova:port uuid="cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da">
Jul 24 18:05:42 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 18:05:42 user nova-compute[70375]:         </nova:port>
Jul 24 18:05:42 user nova-compute[70375]:       </nova:ports>
Jul 24 18:05:42 user nova-compute[70375]:     </nova:instance>
Jul 24 18:05:42 user nova-compute[70375]:   </metadata>
Jul 24 18:05:42 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:05:42 user nova-compute[70375]:     <system>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="serial">b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3</entry>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="uuid">b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3</entry>
Jul 24 18:05:42 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:05:42 user nova-compute[70375]:     </system>
Jul 24 18:05:42 user nova-compute[70375]:   </sysinfo>
Jul 24 18:05:42 user nova-compute[70375]:   <os>
Jul 24 18:05:42 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:05:42 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:05:42 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:05:42 user nova-compute[70375]:   </os>
Jul 24 18:05:42 user nova-compute[70375]:   <features>
Jul 24 18:05:42 user nova-compute[70375]:     <acpi/>
Jul 24 18:05:42 user nova-compute[70375]:     <apic/>
Jul 24 18:05:42 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:05:42 user nova-compute[70375]:   </features>
Jul 24 18:05:42 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:05:42 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:05:42 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:05:42 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:05:42 user nova-compute[70375]:   </clock>
Jul 24 18:05:42 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:05:42 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:05:42 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:05:42 user nova-compute[70375]:   </cpu>
Jul 24 18:05:42 user nova-compute[70375]:   <devices>
Jul 24 18:05:42 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:05:42 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:05:42 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk"/>
Jul 24 18:05:42 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:05:42 user nova-compute[70375]:     </disk>
Jul 24 18:05:42 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:05:42 user nova-compute[70375]:       <mac address="fa:16:3e:69:d6:04"/>
Jul 24 18:05:42 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:05:42 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:05:42 user nova-compute[70375]:       <target dev="tapcfbe2cdc-8d"/>
Jul 24 18:05:42 user nova-compute[70375]:     </interface>
Jul 24 18:05:42 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:05:42 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/console.log" append="off"/>
Jul 24 18:05:42 user nova-compute[70375]:     </serial>
Jul 24 18:05:42 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:05:42 user nova-compute[70375]:     <video>
Jul 24 18:05:42 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:05:42 user nova-compute[70375]:     </video>
Jul 24 18:05:42 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:05:42 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:05:42 user nova-compute[70375]:     </rng>
Jul 24 18:05:42 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:05:42 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:05:42 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:05:42 user nova-compute[70375]:     </memballoon>
Jul 24 18:05:42 user nova-compute[70375]:   </devices>
Jul 24 18:05:42 user nova-compute[70375]: </domain>
Jul 24 18:05:42 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1513166301',display_name='tempest-ServersNegativeTestJSON-server-1513166301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1513166301',id=35,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-z4hj71s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:05:40Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG os_vif [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbe2cdc-8d, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfbe2cdc-8d, col_values=(('external_ids', {'iface-id': 'cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d6:04', 'vm-uuid': 'b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:42 user nova-compute[70375]: INFO os_vif [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d')
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101.delta 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101.delta 1073741824" returned: 0 in 0.050s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] No VIF found with MAC fa:16:3e:69:d6:04, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updated VIF entry in instance network info cache for port cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG nova.network.neutron [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updating instance_info_cache with network_info: [{"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:05:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f3319799-8a4d-41dc-8a23-1a2c41fe67d9 req-ebf89225-c47d-4975-846b-40e7ae790f9a service nova] Releasing lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:05:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:05:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221946.4294996, b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] VM Resumed (Lifecycle Event)
Jul 24 18:05:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] No waiting events found dispatching network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:05:46 user nova-compute[70375]: WARNING nova.compute.manager [req-4cf3aecd-fca2-4afe-9ca1-7c4fdd206681 req-666e7efd-d2b6-475a-83d0-9c7cfae0dc78 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received unexpected event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da for instance with vm_state building and task_state spawning.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] No waiting events found dispatching network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:05:46 user nova-compute[70375]: WARNING nova.compute.manager [req-a15c7dd2-adcc-4e6f-9df7-be8135fff535 req-aecd357c-55da-446a-8328-54f53111872e service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received unexpected event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da for instance with vm_state building and task_state spawning.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:05:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:05:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=24.180042266845703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Instance spawned successfully.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690221946.4304264, b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] VM Started (Lifecycle Event)
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:05:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101.delta /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:05:46 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:05:47 user nova-compute[70375]: INFO nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Took 6.79 seconds to spawn the instance on the hypervisor.
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:05:47 user nova-compute[70375]: INFO nova.compute.manager [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Took 7.54 seconds to build instance.
Jul 24 18:05:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-39549579-b307-4b26-ac59-ce424a5a259a tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.665s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101.delta /opt/stack/data/nova/instances/snapshots/tmp1n4s3r62/dce7560151584127bb2bcedb35ff2101" returned: 0 in 0.417s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:05:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Snapshot extracted, beginning image upload
Jul 24 18:05:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:05:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:05:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Snapshot image upload complete
Jul 24 18:05:49 user nova-compute[70375]: INFO nova.compute.manager [None req-f0ba5fb9-6408-438c-a4c9-db59c7189ff7 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Took 8.05 seconds to snapshot the instance on the hypervisor.
Jul 24 18:05:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:05:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:03 user nova-compute[70375]: INFO nova.compute.manager [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Terminating instance
Jul 24 18:06:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-764edd03-db24-411e-b2b5-de143f0bdfc7 req-66bd1598-a5ff-4964-a9b3-99ac7a99928a service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Instance destroyed successfully.
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1983989265',display_name='tempest-TestVolumeBootPattern-server-1983989265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1983989265',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-tx79ao2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:04:31Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=29bcdf8a-0fac-4759-a9c2-eaa427f643d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "address": "fa:16:3e:46:b0:8a", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46866f7-ad", "ovs_interfaceid": "f46866f7-adba-4144-a79f-745e9c3ee0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_vif [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf46866f7-ad, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: INFO os_vif [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=f46866f7-adba-4144-a79f-745e9c3ee0dd,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46866f7-ad')
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcWlKYVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:06:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a27e1-5fff-4e45-9399-e1948acef040]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:06:04 user nova-compute[70375]: No targets found.
Jul 24 18:06:04 user nova-compute[70375]: iSNS:
Jul 24 18:06:04 user nova-compute[70375]: No targets found.
Jul 24 18:06:04 user nova-compute[70375]: STATIC:
Jul 24 18:06:04 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:06:04 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:06:04 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:06:04 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:06:04 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:06:04 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:06:04 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f
Jul 24 18:06:04 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:06:04 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:06:04 user nova-compute[70375]: FIRMWARE:
Jul 24 18:06:04 user nova-compute[70375]: No targets found.
Jul 24 18:06:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:06:04 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:06:04 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e626366-890d-401e-a619-19b8ed5e5939]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872f9a8-39cb-41d1-975f-92edefcbf274]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:04 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:04 user nova-compute[70375]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)
Jul 24 18:06:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:04 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:04 user nova-compute[70375]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f (non-flash)
Jul 24 18:06:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630442c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[87593ead-f1c4-41c3-a22d-392033e0ce17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bcb8d-8127-4a13-895b-bd1720090480]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1cc2e1-d52f-4aa3-be53-e91c96d9a131]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e8995-0bc7-4a73-8221-5eee91181336]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5024b45', '/dev/disk/by-id/scsi-1SCST_BIO5024b45-48d7390115930e7d', '/dev/disk/by-id/scsi-23438643733393031') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[735958a3-f49a-4428-9c65-cb2da44f8008]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0b3f5-23a2-4561-9d94-67eb4c088f1f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[773056da-4879-4f79-8cbb-7b7b48f5dbfd]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260]
Jul 24 18:06:04 user nova-compute[70375]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f, portal: 172.16.0.220,3260] successful.
Jul 24 18:06:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.091s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c261f7-c5f2-4136-9a66-c7d64f22a4df]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (421ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:06:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Deleting instance files /opt/stack/data/nova/instances/29bcdf8a-0fac-4759-a9c2-eaa427f643d6_del
Jul 24 18:06:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Deletion of /opt/stack/data/nova/instances/29bcdf8a-0fac-4759-a9c2-eaa427f643d6_del complete
Jul 24 18:06:04 user nova-compute[70375]: INFO nova.compute.manager [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Took 1.30 seconds to destroy the instance on the hypervisor.
Jul 24 18:06:04 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:05 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Took 0.65 seconds to deallocate network for instance.
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-5030127b-4ea8-4f4a-aebd-b28c91943d14 req-93613415-f764-4416-b0bf-8c7da1cbb6e0 service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-deleted-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:05 user nova-compute[70375]: WARNING nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state active and task_state deleting.
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:05 user nova-compute[70375]: WARNING nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state active and task_state deleting.
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:05 user nova-compute[70375]: WARNING nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state active and task_state deleting.
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-unplugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Acquiring lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] No waiting events found dispatching network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:05 user nova-compute[70375]: WARNING nova.compute.manager [req-67e0b74f-aea7-458f-aeda-4ecc391573af req-621b2a17-94a2-4677-8ec5-a970bff37bcc service nova] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Received unexpected event network-vif-plugged-f46866f7-adba-4144-a79f-745e9c3ee0dd for instance with vm_state active and task_state deleting.
Jul 24 18:06:06 user nova-compute[70375]: INFO nova.compute.manager [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Took 0.75 seconds to detach 1 volumes for instance.
Jul 24 18:06:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Deleting volume: 4b23bbe7-ec2b-4ec2-aedc-a798aba87e1f {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:06:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:06 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance 29bcdf8a-0fac-4759-a9c2-eaa427f643d6
Jul 24 18:06:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1a1f229-9440-4b4e-9ec6-3a69f7f0b798 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "29bcdf8a-0fac-4759-a9c2-eaa427f643d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:19 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690221964.1846275, 29bcdf8a-0fac-4759-a9c2-eaa427f643d6 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:06:19 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] VM Stopped (Lifecycle Event)
Jul 24 18:06:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-824fc0aa-1c9a-4440-bbe5-85cd1a685c81 None None] [instance: 29bcdf8a-0fac-4759-a9c2-eaa427f643d6] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:06:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:06:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing instance network info cache due to event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updated VIF entry in instance network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-04a1ede5-b323-44c0-aba7-20c2805dbd82 req-736fece8-47b9-4983-9156-427400303693 service nova] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:06:33 user nova-compute[70375]: INFO nova.compute.manager [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] instance snapshotting
Jul 24 18:06:33 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Beginning live snapshot process
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa.delta 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa.delta 1073741824" returned: 0 in 0.276s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 18:06:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:06:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] COPY block job progress, current cursor: 27459584 final cursor: 75563008 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:06:36 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 18:06:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:06:36 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa.delta /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:37 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa.delta /opt/stack/data/nova/instances/snapshots/tmpkin27zlj/4c62efa70cbe4bef9c2294df58158eaa" returned: 0 in 0.703s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Snapshot extracted, beginning image upload
Jul 24 18:06:39 user nova-compute[70375]: INFO nova.compute.manager [None req-8b8736e1-613b-43c5-9d08-3b9d87257e95 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Get console output
Jul 24 18:06:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:39 user nova-compute[70375]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 24 18:06:39 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Snapshot image upload complete
Jul 24 18:06:39 user nova-compute[70375]: INFO nova.compute.manager [None req-0433ca54-3ef5-4d2e-9fb3-467a26163460 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Took 5.69 seconds to snapshot the instance on the hypervisor.
Jul 24 18:06:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:42 user nova-compute[70375]: INFO nova.compute.manager [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Attaching volume 2f71dc9a-968a-49e5-839c-2662ed645dc6 to /dev/vdb
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4056f93-e765-4cd3-ac3b-6f201ce3b835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc4097-9b6e-499a-a200-7d0afda70dd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ce04a6-9c61-470b-91a8-1734d43df1f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73887c0-5f46-4726-bb08-af24720110f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:06:42 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8fa1c0-1209-49c7-9c80-0d1abcdb2134]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating existing volume attachment record: c9baf98b-b41b-4d57-8f1e-aaf5c1f1300c {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:06:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:44 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:06:44 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7882MB free_disk=24.05173110961914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:06:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:06:45 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:06:45 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:06:45 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:06:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PieWkqaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:06:48 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:06:48 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:06:48 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b468120-c85c-4c35-bd62-81ff967c90d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:06:48 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01b345-7a98-4363-8e18-8160f2295f26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6] added
Jul 24 18:06:48 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1a9c70-d4f5-4c73-bfe2-4ebf446edd29]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca562fc4-8ded-4db1-9730-4a4a822ee93a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PieWkqaV {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PieWkqaV" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d136fda0-b7cf-4818-b80b-275b44a71f54]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PieWkqaV'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c324b8-fa2b-4610-aac0-65ff07fc4321]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11c94d0-4059-4783-989a-2456f7cb0dd4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[72313354-3795-4df9-b858-c8f6429ffa9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260]
Jul 24 18:06:49 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260] successful.
Jul 24 18:06:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d053c252-d3d9-4d47-a92e-099e4130b319]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88574d-bb50-43f4-a46f-9bc58624d3a7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:06:49 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:06:49 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a09bdb4-5d5e-4333-9c05-dd6dce7a251a]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:06:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PieWkqaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23331633237626133', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331633237626133', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.objects.instance [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:06:50 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:06:50 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 18:06:50 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:06:50 user nova-compute[70375]:   <serial>2f71dc9a-968a-49e5-839c-2662ed645dc6</serial>
Jul 24 18:06:50 user nova-compute[70375]: </disk>
Jul 24 18:06:50 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] No VIF found with MAC fa:16:3e:1e:30:2b, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:06:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-9a3e61c5-57a0-403b-b81d-1fd6844357da tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.462s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:06:51 user nova-compute[70375]: INFO nova.compute.claims [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Claim successful on node user
Jul 24 18:06:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:06:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:06:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.policy [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c1aa740b7404c2e8703488bcd87404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a644d007b4ecdbde7ec4788464675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:06:52 user nova-compute[70375]: INFO nova.virt.block_device [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Booting with volume-backed-image 43e95aac-d02a-49a8-aaa5-04490973ed39 at /dev/vda
Jul 24 18:06:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Successfully created port: 9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing instance network info cache due to event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.network.neutron [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Successfully updated port: 9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-changed-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Refreshing instance network info cache due to event network-changed-9b539894-c678-4ca9-9c36-e3d23129c922. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] Acquiring lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:53 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating instance_info_cache with network_info: [{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance network_info: |[{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] Acquired lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Refreshing network info cache for port 9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updated VIF entry in instance network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0d70583-28b7-48b3-8158-8626143dc041 req-33cccb04-090c-41da-8399-df9fceb73151 service nova] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updated VIF entry in instance network info cache for port 9b539894-c678-4ca9-9c36-e3d23129c922. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating instance_info_cache with network_info: [{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37f87a60-fc6e-4201-b43b-7edc733c5ca5 req-8254cd2c-6eae-4306-8589-43881300983a service nova] Releasing lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing instance network info cache due to event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:06:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:56 user nova-compute[70375]: INFO nova.compute.manager [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Rebooting instance
Jul 24 18:06:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updated VIF entry in instance network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-43e9a2b8-88bd-45a5-908e-d58b39a095e7 req-3d56653c-2e8f-4d10-91d4-f4a23af5b0c3 service nova] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:06:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.utils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e1df7-4841-45d4-b73a-b4cfcd90515a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca387b60-cac7-4508-94b1-9229483933b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c3f5d-5732-48e4-8a13-11efe5372603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[238487f9-68ad-46e4-beca-7c2844e2ce28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:06:57 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:06:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddde88-98d0-4375-a6c6-15b8d4197527]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG os_brick.utils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:06:57 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating existing volume attachment record: 081bae8e-fd41-4349-b524-2917d27d7b71 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:06:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:06:59 user nova-compute[70375]: WARNING nova.compute.manager [req-e48b040f-5362-4b41-93f7-dbc667f8424a req-461757d5-4d57-43a4-9bd9-8da597e06b17 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state active and task_state reboot_started.
Jul 24 18:06:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:06:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance shutdown successfully.
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:01 user nova-compute[70375]: WARNING nova.compute.manager [req-f01834f8-e610-46d8-bb95-210f108945b8 req-eab659f4-f823-4657-9b58-0daed56aa8ba service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state active and task_state reboot_started.
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222023.366701, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] VM Resumed (Lifecycle Event)
Jul 24 18:07:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance running successfully.
Jul 24 18:07:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance soft rebooted successfully.
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222023.3723075, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:03 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] VM Started (Lifecycle Event)
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:03 user nova-compute[70375]: WARNING nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state active and task_state reboot_started.
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:03 user nova-compute[70375]: WARNING nova.compute.manager [req-caef28d5-accf-465a-9530-37e88665c209 req-a7bc7884-769b-4e14-89ae-590dd59a4175 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state active and task_state reboot_started.
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c2c3a1a4-d194-474a-a3ab-2b8ccb313abb tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.304s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:07:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Creating image(s)
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Ensure instance console log exists: /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start _get_guest_xml network_info=[{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '081bae8e-fd41-4349-b524-2917d27d7b71', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edf496ee-bac6-4e86-9b16-c8f2f08f93e1', 'attached_at': '', 'detached_at': '', 'volume_id': '2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'serial': '2e50773b-eb3b-463b-a9f1-9f8eaf851c1e'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:07:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:07:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:07:04 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f736d9-998a-42cf-b1a1-9bcdc5471e1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:07:04 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b538137-59bb-4072-9acd-40ffda77d86a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e] added
Jul 24 18:07:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d2a7e-7bb4-4644-a22d-4a70a0bccb1e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4213659c-efc9-4814-95fa-73627a462e50]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZRojqab {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZRojqab" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cca6d44-ff25-4eeb-852d-7e1af06301f2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZRojqab'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a84711e-ec78-470e-b08b-34b6e311443a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[401353e1-6bf2-4542-9e00-f9e3e3088e79]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:04 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:04 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:04 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:04 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da11729-33eb-4188-93e5-66a7cf0a9c43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260]
Jul 24 18:07:04 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260] successful.
Jul 24 18:07:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f68c64-18dd-4e0f-8ca5-ecd53570187e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c7a34-3b9c-445a-944a-4e4623a3b0e9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:05 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae5241-54fb-42fe-aaeb-d367abe49f3b]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:07:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23234626232373331', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626232373331', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-208816579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-208816579',id=36,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ck8ktxog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:06:52Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=edf496ee-bac6-4e86-9b16-c8f2f08f93e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:07:06 user nova-compute[70375]:   <uuid>edf496ee-bac6-4e86-9b16-c8f2f08f93e1</uuid>
Jul 24 18:07:06 user nova-compute[70375]:   <name>instance-00000024</name>
Jul 24 18:07:06 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:07:06 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:07:06 user nova-compute[70375]:   <metadata>
Jul 24 18:07:06 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:07:06 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-208816579</nova:name>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:07:04</nova:creationTime>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:07:06 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:07:06 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:owner>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 18:07:06 user nova-compute[70375]:       </nova:owner>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:07:06 user nova-compute[70375]:       <nova:ports>
Jul 24 18:07:06 user nova-compute[70375]:         <nova:port uuid="9b539894-c678-4ca9-9c36-e3d23129c922">
Jul 24 18:07:06 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 18:07:06 user nova-compute[70375]:         </nova:port>
Jul 24 18:07:06 user nova-compute[70375]:       </nova:ports>
Jul 24 18:07:06 user nova-compute[70375]:     </nova:instance>
Jul 24 18:07:06 user nova-compute[70375]:   </metadata>
Jul 24 18:07:06 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:07:06 user nova-compute[70375]:     <system>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="serial">edf496ee-bac6-4e86-9b16-c8f2f08f93e1</entry>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="uuid">edf496ee-bac6-4e86-9b16-c8f2f08f93e1</entry>
Jul 24 18:07:06 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:07:06 user nova-compute[70375]:     </system>
Jul 24 18:07:06 user nova-compute[70375]:   </sysinfo>
Jul 24 18:07:06 user nova-compute[70375]:   <os>
Jul 24 18:07:06 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:07:06 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:07:06 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:07:06 user nova-compute[70375]:   </os>
Jul 24 18:07:06 user nova-compute[70375]:   <features>
Jul 24 18:07:06 user nova-compute[70375]:     <acpi/>
Jul 24 18:07:06 user nova-compute[70375]:     <apic/>
Jul 24 18:07:06 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:07:06 user nova-compute[70375]:   </features>
Jul 24 18:07:06 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:07:06 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:07:06 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:07:06 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:07:06 user nova-compute[70375]:   </clock>
Jul 24 18:07:06 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:07:06 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:07:06 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:07:06 user nova-compute[70375]:   </cpu>
Jul 24 18:07:06 user nova-compute[70375]:   <devices>
Jul 24 18:07:06 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:07:06 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:07:06 user nova-compute[70375]:       <source dev="/dev/sde"/>
Jul 24 18:07:06 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:07:06 user nova-compute[70375]:       <serial>2e50773b-eb3b-463b-a9f1-9f8eaf851c1e</serial>
Jul 24 18:07:06 user nova-compute[70375]:     </disk>
Jul 24 18:07:06 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:07:06 user nova-compute[70375]:       <mac address="fa:16:3e:e2:df:5a"/>
Jul 24 18:07:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:06 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:07:06 user nova-compute[70375]:       <target dev="tap9b539894-c6"/>
Jul 24 18:07:06 user nova-compute[70375]:     </interface>
Jul 24 18:07:06 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:07:06 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/console.log" append="off"/>
Jul 24 18:07:06 user nova-compute[70375]:     </serial>
Jul 24 18:07:06 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:07:06 user nova-compute[70375]:     <video>
Jul 24 18:07:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:06 user nova-compute[70375]:     </video>
Jul 24 18:07:06 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:07:06 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:07:06 user nova-compute[70375]:     </rng>
Jul 24 18:07:06 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:07:06 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:07:06 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:07:06 user nova-compute[70375]:     </memballoon>
Jul 24 18:07:06 user nova-compute[70375]:   </devices>
Jul 24 18:07:06 user nova-compute[70375]: </domain>
Jul 24 18:07:06 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-208816579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-208816579',id=36,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ck8ktxog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:06:52Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=edf496ee-bac6-4e86-9b16-c8f2f08f93e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG os_vif [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b539894-c6, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b539894-c6, col_values=(('external_ids', {'iface-id': '9b539894-c678-4ca9-9c36-e3d23129c922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:df:5a', 'vm-uuid': 'edf496ee-bac6-4e86-9b16-c8f2f08f93e1'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:06 user nova-compute[70375]: INFO os_vif [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6')
Jul 24 18:07:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:07:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:e2:df:5a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:07 user nova-compute[70375]: WARNING nova.compute.manager [req-84b62cc4-6c52-4a9e-9840-d4066020bf6f req-10b1c104-35b4-49b7-a5d1-596325e64517 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state building and task_state spawning.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222029.6435955, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Resumed (Lifecycle Event)
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance spawned successfully.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222029.6476989, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Started (Lifecycle Event)
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Took 5.11 seconds to spawn the instance on the hypervisor.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:09 user nova-compute[70375]: INFO nova.compute.manager [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Took 18.37 seconds to build instance.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:09 user nova-compute[70375]: WARNING nova.compute.manager [req-1178f533-ad48-4095-ba3d-88118de11ea6 req-6be42f40-4307-40c4-92ba-f32a89247e88 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state None.
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-e1db307c-6e82-4883-92c1-7a4c667f9687 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.469s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:07:10 user nova-compute[70375]: INFO nova.compute.claims [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Claim successful on node user
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:07:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:07:10 user nova-compute[70375]: INFO nova.virt.block_device [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Booting with volume bc2420ee-312f-4c7d-87b2-d33431eea463 at /dev/vda
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.utils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c97c73-652e-4096-9795-88881c4241ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26e4d8-0917-493d-b9e6-0d9caf400a05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3722e68-9f70-454e-a4b3-4d39ce9c7609]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a000a51-544b-4f83-8528-578ca059c607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:07:10 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:07:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89679a6-ce03-43be-bec1-04f1cf5c2d2e]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG os_brick.utils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:07:10 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updating existing volume attachment record: dfe604d8-3f89-43d5-b08d-1ea7a73a222c {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:07:11 user nova-compute[70375]: DEBUG nova.policy [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:07:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Successfully created port: 72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Successfully updated port: 72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-changed-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Refreshing instance network info cache due to event network-changed-72f7de7c-535c-4a4d-bf67-7574132c87cf. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] Acquiring lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:07:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updating instance_info_cache with network_info: [{"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Instance network_info: |[{"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] Acquired lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Refreshing network info cache for port 72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updated VIF entry in instance network info cache for port 72f7de7c-535c-4a4d-bf67-7574132c87cf. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG nova.network.neutron [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updating instance_info_cache with network_info: [{"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f066616b-4f55-4612-aa18-b55bc0b00761 req-36e0269e-634e-43db-8578-fd0e216576ce service nova] Releasing lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:07:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:07:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Creating image(s)
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Ensure instance console log exists: /opt/stack/data/nova/instances/9b6f5a7b-cce7-4693-8bbf-c03628574639/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Start _get_guest_xml network_info=[{"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dfe604d8-3f89-43d5-b08d-1ea7a73a222c', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elGyADpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b6f5a7b-cce7-4693-8bbf-c03628574639', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc2420ee-312f-4c7d-87b2-d33431eea463', 'serial': 'bc2420ee-312f-4c7d-87b2-d33431eea463'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:07:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:18 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elGyADpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:07:18 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:07:18 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:07:18 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64d5f1-3735-4ee1-803e-39b42fec3d38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:07:18 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf544f-156f-45b6-95bd-51788d0934d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463] added
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff698747-59e7-4c9d-b19e-e71b0b6506c5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55890a7a-cee4-49b6-a1f9-0cde02879714]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elGyADpo {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elGyADpo" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0361d-ccaf-4e12-9db2-1c00d8575a65]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'elGyADpo'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be550c3-ccfb-4fb9-aa92-0cfb6b912a46]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[69176a76-3cc1-4a3c-be39-9da65f77fc08]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5179ec9b-6a49-451b-adb9-3c81e21407c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260]
Jul 24 18:07:18 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260] successful.
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bdf653-5e0a-42cb-80f9-12d379cce18f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f289bba8-69d2-46a0-a786-167b5d50aba3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:18 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:07:18 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f6c8ce-cf7c-4b83-9d86-7d3f7f2396c0]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:07:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elGyADpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26466393738396265', 'path': '/dev/sdf'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466393738396265', 'path': '/dev/sdf'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-78919588',display_name='tempest-TestVolumeBootPattern-volume-backed-server-78919588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-78919588',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGA7i/hQUkXfKMjDXTU1MaqIWzx63Du4tq+wPpvMn0zr/EosiOb4fpmWcXNad0zy1GUMPKu07S+yFB3Q7klQzOk92dHXj60E+Q7yNv0UOwzPJ6NUATrzt4pcSGXeZCNIw==',key_name='tempest-keypair-1227481815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-3kop3tpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=9b6f5a7b-cce7-4693-8bbf-c03628574639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.objects.instance [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b6f5a7b-cce7-4693-8bbf-c03628574639 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:07:19 user nova-compute[70375]:   <uuid>9b6f5a7b-cce7-4693-8bbf-c03628574639</uuid>
Jul 24 18:07:19 user nova-compute[70375]:   <name>instance-00000025</name>
Jul 24 18:07:19 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:07:19 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:07:19 user nova-compute[70375]:   <metadata>
Jul 24 18:07:19 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:07:19 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:07:19 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-78919588</nova:name>
Jul 24 18:07:19 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:07:18</nova:creationTime>
Jul 24 18:07:19 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:07:19 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:07:19 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:07:19 user nova-compute[70375]:       <nova:owner>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:07:19 user nova-compute[70375]:       </nova:owner>
Jul 24 18:07:19 user nova-compute[70375]:       <nova:ports>
Jul 24 18:07:19 user nova-compute[70375]:         <nova:port uuid="72f7de7c-535c-4a4d-bf67-7574132c87cf">
Jul 24 18:07:19 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 18:07:19 user nova-compute[70375]:         </nova:port>
Jul 24 18:07:19 user nova-compute[70375]:       </nova:ports>
Jul 24 18:07:19 user nova-compute[70375]:     </nova:instance>
Jul 24 18:07:19 user nova-compute[70375]:   </metadata>
Jul 24 18:07:19 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:07:19 user nova-compute[70375]:     <system>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="serial">9b6f5a7b-cce7-4693-8bbf-c03628574639</entry>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="uuid">9b6f5a7b-cce7-4693-8bbf-c03628574639</entry>
Jul 24 18:07:19 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:07:19 user nova-compute[70375]:     </system>
Jul 24 18:07:19 user nova-compute[70375]:   </sysinfo>
Jul 24 18:07:19 user nova-compute[70375]:   <os>
Jul 24 18:07:19 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:07:19 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:07:19 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:07:19 user nova-compute[70375]:   </os>
Jul 24 18:07:19 user nova-compute[70375]:   <features>
Jul 24 18:07:19 user nova-compute[70375]:     <acpi/>
Jul 24 18:07:19 user nova-compute[70375]:     <apic/>
Jul 24 18:07:19 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:07:19 user nova-compute[70375]:   </features>
Jul 24 18:07:19 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:07:19 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:07:19 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:07:19 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:07:19 user nova-compute[70375]:   </clock>
Jul 24 18:07:19 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:07:19 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:07:19 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:07:19 user nova-compute[70375]:   </cpu>
Jul 24 18:07:19 user nova-compute[70375]:   <devices>
Jul 24 18:07:19 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:07:19 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:07:19 user nova-compute[70375]:       <source dev="/dev/sdf"/>
Jul 24 18:07:19 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:07:19 user nova-compute[70375]:       <serial>bc2420ee-312f-4c7d-87b2-d33431eea463</serial>
Jul 24 18:07:19 user nova-compute[70375]:     </disk>
Jul 24 18:07:19 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:07:19 user nova-compute[70375]:       <mac address="fa:16:3e:d6:16:a6"/>
Jul 24 18:07:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:19 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:07:19 user nova-compute[70375]:       <target dev="tap72f7de7c-53"/>
Jul 24 18:07:19 user nova-compute[70375]:     </interface>
Jul 24 18:07:19 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:07:19 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/9b6f5a7b-cce7-4693-8bbf-c03628574639/console.log" append="off"/>
Jul 24 18:07:19 user nova-compute[70375]:     </serial>
Jul 24 18:07:19 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:07:19 user nova-compute[70375]:     <video>
Jul 24 18:07:19 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:19 user nova-compute[70375]:     </video>
Jul 24 18:07:19 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:07:19 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:07:19 user nova-compute[70375]:     </rng>
Jul 24 18:07:19 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:07:19 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:07:19 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:07:19 user nova-compute[70375]:     </memballoon>
Jul 24 18:07:19 user nova-compute[70375]:   </devices>
Jul 24 18:07:19 user nova-compute[70375]: </domain>
Jul 24 18:07:19 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-78919588',display_name='tempest-TestVolumeBootPattern-volume-backed-server-78919588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-78919588',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGA7i/hQUkXfKMjDXTU1MaqIWzx63Du4tq+wPpvMn0zr/EosiOb4fpmWcXNad0zy1GUMPKu07S+yFB3Q7klQzOk92dHXj60E+Q7yNv0UOwzPJ6NUATrzt4pcSGXeZCNIw==',key_name='tempest-keypair-1227481815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-3kop3tpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=9b6f5a7b-cce7-4693-8bbf-c03628574639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG os_vif [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72f7de7c-53, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72f7de7c-53, col_values=(('external_ids', {'iface-id': '72f7de7c-535c-4a4d-bf67-7574132c87cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:16:a6', 'vm-uuid': '9b6f5a7b-cce7-4693-8bbf-c03628574639'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:19 user nova-compute[70375]: INFO os_vif [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53')
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:07:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:d6:16:a6, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:07:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] No waiting events found dispatching network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:21 user nova-compute[70375]: WARNING nova.compute.manager [req-76d05171-10a2-4c0b-be9e-db28aaa6dc1a req-55853f33-5920-4ae1-b2f4-ee90618651eb service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received unexpected event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf for instance with vm_state building and task_state spawning.
Jul 24 18:07:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222043.1512005, 9b6f5a7b-cce7-4693-8bbf-c03628574639 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] VM Resumed (Lifecycle Event)
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Instance spawned successfully.
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222043.1527808, 9b6f5a7b-cce7-4693-8bbf-c03628574639 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] VM Started (Lifecycle Event)
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Took 5.17 seconds to spawn the instance on the hypervisor.
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] No waiting events found dispatching network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:23 user nova-compute[70375]: WARNING nova.compute.manager [req-e1c15e90-ad7a-4ba0-ba92-ac3ec807ec70 req-9fa09fbd-0819-44cc-882d-1721579ce785 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received unexpected event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf for instance with vm_state building and task_state spawning.
Jul 24 18:07:23 user nova-compute[70375]: INFO nova.compute.manager [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Took 13.25 seconds to build instance.
Jul 24 18:07:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-888b95b0-0151-4730-96ec-cbc10be1a43f tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.463s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:07:30 user nova-compute[70375]: INFO nova.compute.claims [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Claim successful on node user
Jul 24 18:07:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:07:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:07:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Creating image(s)
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "/opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "/opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "/opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG nova.policy [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54ed6f06c3524fae8e6dcd4514c97fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0efa461cc94bd594ad5e72f98d11f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.166s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk 1073741824" returned: 0 in 0.062s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Cannot resize image /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'migration_context' on Instance uuid 279e06b7-babd-4740-b91a-e01d432720d5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Ensure instance console log exists: /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Successfully created port: d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Successfully updated port: d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquired lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-changed-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Refreshing instance network info cache due to event network-changed-d43d8b2e-8035-4231-a01b-c855a33942ea. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] Acquiring lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Updating instance_info_cache with network_info: [{"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Releasing lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Instance network_info: |[{"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] Acquired lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Refreshing network info cache for port d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Start _get_guest_xml network_info=[{"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:07:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284757743',display_name='tempest-ServersNegativeTestJSON-server-284757743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284757743',id=38,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-6n73ms1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:07:31Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=279e06b7-babd-4740-b91a-e01d432720d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'pci_devices' on Instance uuid 279e06b7-babd-4740-b91a-e01d432720d5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:07:33 user nova-compute[70375]:   <uuid>279e06b7-babd-4740-b91a-e01d432720d5</uuid>
Jul 24 18:07:33 user nova-compute[70375]:   <name>instance-00000026</name>
Jul 24 18:07:33 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:07:33 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:07:33 user nova-compute[70375]:   <metadata>
Jul 24 18:07:33 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:07:33 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:name>tempest-ServersNegativeTestJSON-server-284757743</nova:name>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:07:33</nova:creationTime>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:07:33 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:07:33 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:owner>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:user uuid="54ed6f06c3524fae8e6dcd4514c97fad">tempest-ServersNegativeTestJSON-750541146-project-member</nova:user>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:project uuid="4d0efa461cc94bd594ad5e72f98d11f9">tempest-ServersNegativeTestJSON-750541146</nova:project>
Jul 24 18:07:33 user nova-compute[70375]:       </nova:owner>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:07:33 user nova-compute[70375]:       <nova:ports>
Jul 24 18:07:33 user nova-compute[70375]:         <nova:port uuid="d43d8b2e-8035-4231-a01b-c855a33942ea">
Jul 24 18:07:33 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 18:07:33 user nova-compute[70375]:         </nova:port>
Jul 24 18:07:33 user nova-compute[70375]:       </nova:ports>
Jul 24 18:07:33 user nova-compute[70375]:     </nova:instance>
Jul 24 18:07:33 user nova-compute[70375]:   </metadata>
Jul 24 18:07:33 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:07:33 user nova-compute[70375]:     <system>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="serial">279e06b7-babd-4740-b91a-e01d432720d5</entry>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="uuid">279e06b7-babd-4740-b91a-e01d432720d5</entry>
Jul 24 18:07:33 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:07:33 user nova-compute[70375]:     </system>
Jul 24 18:07:33 user nova-compute[70375]:   </sysinfo>
Jul 24 18:07:33 user nova-compute[70375]:   <os>
Jul 24 18:07:33 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:07:33 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:07:33 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:07:33 user nova-compute[70375]:   </os>
Jul 24 18:07:33 user nova-compute[70375]:   <features>
Jul 24 18:07:33 user nova-compute[70375]:     <acpi/>
Jul 24 18:07:33 user nova-compute[70375]:     <apic/>
Jul 24 18:07:33 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:07:33 user nova-compute[70375]:   </features>
Jul 24 18:07:33 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:07:33 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:07:33 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:07:33 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:07:33 user nova-compute[70375]:   </clock>
Jul 24 18:07:33 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:07:33 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:07:33 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:07:33 user nova-compute[70375]:   </cpu>
Jul 24 18:07:33 user nova-compute[70375]:   <devices>
Jul 24 18:07:33 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:07:33 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:07:33 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk"/>
Jul 24 18:07:33 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:07:33 user nova-compute[70375]:     </disk>
Jul 24 18:07:33 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:07:33 user nova-compute[70375]:       <mac address="fa:16:3e:a5:17:d2"/>
Jul 24 18:07:33 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:33 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:07:33 user nova-compute[70375]:       <target dev="tapd43d8b2e-80"/>
Jul 24 18:07:33 user nova-compute[70375]:     </interface>
Jul 24 18:07:33 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:07:33 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/console.log" append="off"/>
Jul 24 18:07:33 user nova-compute[70375]:     </serial>
Jul 24 18:07:33 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:07:33 user nova-compute[70375]:     <video>
Jul 24 18:07:33 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:07:33 user nova-compute[70375]:     </video>
Jul 24 18:07:33 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:07:33 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:07:33 user nova-compute[70375]:     </rng>
Jul 24 18:07:33 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:07:33 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:07:33 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:07:33 user nova-compute[70375]:     </memballoon>
Jul 24 18:07:33 user nova-compute[70375]:   </devices>
Jul 24 18:07:33 user nova-compute[70375]: </domain>
Jul 24 18:07:33 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284757743',display_name='tempest-ServersNegativeTestJSON-server-284757743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284757743',id=38,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-6n73ms1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:07:31Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=279e06b7-babd-4740-b91a-e01d432720d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG os_vif [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd43d8b2e-80, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd43d8b2e-80, col_values=(('external_ids', {'iface-id': 'd43d8b2e-8035-4231-a01b-c855a33942ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:17:d2', 'vm-uuid': '279e06b7-babd-4740-b91a-e01d432720d5'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:33 user nova-compute[70375]: INFO os_vif [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80')
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] No VIF found with MAC fa:16:3e:a5:17:d2, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Updated VIF entry in instance network info cache for port d43d8b2e-8035-4231-a01b-c855a33942ea. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG nova.network.neutron [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Updating instance_info_cache with network_info: [{"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-81d4edcc-f5ff-419c-9563-4384c7193bb4 req-04b53f0c-dd52-4090-b86a-ec062d90d380 service nova] Releasing lock "refresh_cache-279e06b7-babd-4740-b91a-e01d432720d5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] No waiting events found dispatching network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:35 user nova-compute[70375]: WARNING nova.compute.manager [req-e7dd1057-8d46-4a78-887b-010bd34cd17d req-775725b4-a2fb-4dc9-ad43-6b00d62faa38 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received unexpected event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea for instance with vm_state building and task_state spawning.
Jul 24 18:07:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222057.2298508, 279e06b7-babd-4740-b91a-e01d432720d5 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] VM Resumed (Lifecycle Event)
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Instance spawned successfully.
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222057.2312005, 279e06b7-babd-4740-b91a-e01d432720d5 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] VM Started (Lifecycle Event)
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] No waiting events found dispatching network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:37 user nova-compute[70375]: WARNING nova.compute.manager [req-188ed203-8d21-4de4-99da-e086ecc224c0 req-72012621-f9be-4e43-89b2-b4c24f34d42d service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received unexpected event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea for instance with vm_state building and task_state spawning.
Jul 24 18:07:37 user nova-compute[70375]: INFO nova.compute.manager [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Took 6.57 seconds to build instance.
Jul 24 18:07:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2d75d909-bea4-4b79-8048-28c2f396b5ba tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:39 user nova-compute[70375]: INFO nova.compute.manager [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Terminating instance
Jul 24 18:07:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:07:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-7ccb3f60-7a4f-43b3-840c-1a0b3c8936d8 req-39f31a36-d934-4d5d-9eee-a246fec3c473 service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-unplugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:07:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Instance destroyed successfully.
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'resources' on Instance uuid 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1833106531',display_name='tempest-ServerActionsTestOtherA-server-1833106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1833106531',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-4o6g5nhk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=8fec2e88-1d18-4b2b-b8e4-b03d39c9646f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "9adfd0ef-ef85-4592-be45-816bdf90235d", "address": "fa:16:3e:f7:0f:1a", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adfd0ef-ef", "ovs_interfaceid": "9adfd0ef-ef85-4592-be45-816bdf90235d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_vif [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9adfd0ef-ef, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:07:40 user nova-compute[70375]: INFO os_vif [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:0f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adfd0ef-ef85-4592-be45-816bdf90235d,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adfd0ef-ef')
Jul 24 18:07:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrFhECZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:07:40 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[de21863e-84c4-47e3-8242-4428367c4cff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:07:40 user nova-compute[70375]: No targets found.
Jul 24 18:07:40 user nova-compute[70375]: iSNS:
Jul 24 18:07:40 user nova-compute[70375]: No targets found.
Jul 24 18:07:40 user nova-compute[70375]: STATIC:
Jul 24 18:07:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:07:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:07:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:07:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b
Jul 24 18:07:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:07:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:07:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6
Jul 24 18:07:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:07:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:07:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463
Jul 24 18:07:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:07:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:07:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:07:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:07:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:07:40 user nova-compute[70375]: FIRMWARE:
Jul 24 18:07:40 user nova-compute[70375]: No targets found.
Jul 24 18:07:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:07:40 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:07:40 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603070f-8a23-47b6-b866-3421c9766a49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[09264b7d-dcc7-4a8e-afa0-7f668310cf94]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:07:40 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:07:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe656aad360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[56666c95-a421-4a23-bc5a-f4786d24aef6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bde07-04ca-48a0-8553-ca22db5f477f]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cf002-9fd7-415e-91ec-c2ce0ba0af34]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ba201-f3a4-4572-89b4-e15ad9d26864]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9119007-4ba1-425d-a508-34dc83f75f0f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f70741-8fdb-4553-9fb9-10da9bedccd5]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260]
Jul 24 18:07:41 user nova-compute[70375]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b, portal: 172.16.0.220,3260] successful.
Jul 24 18:07:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58e4e392-68f3-4083-8350-1fb33054bf5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45bc88-3d93-4341-8686-35c46bc90906]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] <== disconnect_volume: return (344ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:07:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Deleting instance files /opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f_del
Jul 24 18:07:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Deletion of /opt/stack/data/nova/instances/8fec2e88-1d18-4b2b-b8e4-b03d39c9646f_del complete
Jul 24 18:07:41 user nova-compute[70375]: INFO nova.compute.manager [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 24 18:07:41 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:07:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] Acquiring lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] No waiting events found dispatching network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:07:42 user nova-compute[70375]: WARNING nova.compute.manager [req-61510c8e-c027-4520-a334-a2c82908a95b req-057e40aa-7ca2-423b-855d-003bf98536ac service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received unexpected event network-vif-plugged-9adfd0ef-ef85-4592-be45-816bdf90235d for instance with vm_state active and task_state deleting.
Jul 24 18:07:42 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:07:42 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Took 1.48 seconds to deallocate network for instance.
Jul 24 18:07:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-a4b0bb12-a39c-4fa7-b5d5-4dc2bc0dbdf5 req-62cdc994-1abf-48b1-b9f8-0f5a91715cfa service nova] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Received event network-vif-deleted-9adfd0ef-ef85-4592-be45-816bdf90235d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:43 user nova-compute[70375]: INFO nova.compute.manager [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Took 0.89 seconds to detach 1 volumes for instance.
Jul 24 18:07:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Deleting volume: 58e4e392-68f3-4083-8350-1fb33054bf5b {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Deleted allocations for instance 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c89fe714-43a0-440e-b026-2db8591d1b02 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "8fec2e88-1d18-4b2b-b8e4-b03d39c9646f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.426s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:45 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:45 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:07:45 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=24.037803649902344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:07:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9228b8cf-e00a-4a57-9762-3e9063199d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9b6f5a7b-cce7-4693-8bbf-c03628574639 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 279e06b7-babd-4740-b91a-e01d432720d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:07:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:07:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:55 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222060.6619384, 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:07:55 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] VM Stopped (Lifecycle Event)
Jul 24 18:07:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a4ce02ac-2bcc-45a4-ad7e-ee9a9fe11b5f None None] [instance: 8fec2e88-1d18-4b2b-b8e4-b03d39c9646f] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:07:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:07:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:08:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'flavor' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:27 user nova-compute[70375]: INFO nova.compute.manager [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attaching volume 5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d to /dev/vdb
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.utils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07fbad-5012-4c55-951a-a7d088a6b960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79e0ef-6847-4e7c-8293-c6cb053d1718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e67fb-d8e0-47af-8abf-768f65185d92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b867272-b213-4b02-91c5-be450c795467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:08:27 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:08:27 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb5293-9ead-49ac-a276-219f1dcaf0d0]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG os_brick.utils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:08:27 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating existing volume attachment record: b2769379-8ee5-4c12-9e09-8a585ed70b6b {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:08:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:08:34 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:34 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:34 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f58d2-6200-4c27-a45b-9f8511ba2a97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:08:34 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472206d-1bdb-46d1-9768-b41df0beedc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d] added
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2904a8-8e80-4682-a8dc-431f2bd4b737]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3909c3c-5716-4db9-ad8b-de7083be7df5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQHwLkdx {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQHwLkdx" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541a883-3b19-4149-a844-0b879e827319]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQHwLkdx'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860f453-4806-47b9-b80c-88118b315121]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf00644-159f-4768-860c-aac94c11c79a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14fac5-1ff4-44a9-9a6a-06caf931d527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260]
Jul 24 18:08:34 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260] successful.
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b603d-3339-443c-8023-b2518ad9082c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd9f785-f6ba-4a4a-b8de-c2e405c6c028]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:34 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02251c-399b-46bb-a6d6-736fd558f47e]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:08:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:35 user nova-compute[70375]: INFO nova.compute.manager [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Terminating instance
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updating instance_info_cache with network_info: [{"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-184e5f1c-e463-4bd6-a9b0-f44a35748220" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-3fc2c653-f450-4365-b5c5-7c16f34111f8 req-d2a5308c-02bc-4af7-9164-bd38ae5175c2 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-unplugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Instance destroyed successfully.
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lazy-loading 'resources' on Instance uuid 9228b8cf-e00a-4a57-9762-3e9063199d63 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T17:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-180884339',display_name='tempest-ServerActionsTestOtherA-server-624507986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-180884339',id=16,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhGnY6C8c8BM4Z70/iy0ojoGWaylDqHL78AEZDHv5E6oOPQQ2N6s6VxWB/RwR+86UVTSFhakTSF3M1QvUXE+fSPeCliRLiActhkgqW/er5HM9fLDMJEhkcSla/grOBukg==',key_name='tempest-keypair-1403040028',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:56:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d07a82b57ae84e8892d950cdc0d7507b',ramdisk_id='',reservation_id='r-j7wa6w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-528723047',owner_user_name='tempest-ServerActionsTestOtherA-528723047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa75ae32ac1049f794ce2f8433df6529',uuid=9228b8cf-e00a-4a57-9762-3e9063199d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converting VIF {"id": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "address": "fa:16:3e:19:ad:ce", "network": {"id": "9b621321-b9a7-4cc3-a533-209897b5aad4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1805606292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d07a82b57ae84e8892d950cdc0d7507b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33dfa8-db", "ovs_interfaceid": "cc33dfa8-db53-43b9-846b-e8f09e846c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG os_vif [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23538636133363561', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538636133363561', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc33dfa8-db, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:35 user nova-compute[70375]: INFO os_vif [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ad:ce,bridge_name='br-int',has_traffic_filtering=True,id=cc33dfa8-db53-43b9-846b-e8f09e846c71,network=Network(9b621321-b9a7-4cc3-a533-209897b5aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33dfa8-db')
Jul 24 18:08:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Deleting instance files /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63_del
Jul 24 18:08:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Deletion of /opt/stack/data/nova/instances/9228b8cf-e00a-4a57-9762-3e9063199d63_del complete
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'flavor' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:08:35 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:08:35 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:08:35 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:08:35 user nova-compute[70375]:   <serial>5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d</serial>
Jul 24 18:08:35 user nova-compute[70375]: </disk>
Jul 24 18:08:35 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:35 user nova-compute[70375]: INFO nova.compute.manager [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 18:08:35 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:08:35 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No VIF found with MAC fa:16:3e:77:92:e7, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:36 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Took 0.47 seconds to deallocate network for instance.
Jul 24 18:08:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8ee650bc-ca1c-4bb6-a330-8f268542c3f2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.838s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-aab1f001-141b-4ebd-9c6c-e6b21b65c05b req-ec668e17-a966-4738-960e-484989a4342e service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-deleted-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:08:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:36 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Deleted allocations for instance 9228b8cf-e00a-4a57-9762-3e9063199d63
Jul 24 18:08:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54a0c6dc-c74b-435f-a1c4-b1061f33fe37 tempest-ServerActionsTestOtherA-528723047 tempest-ServerActionsTestOtherA-528723047-project-member] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] Acquiring lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] Lock "9228b8cf-e00a-4a57-9762-3e9063199d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] No waiting events found dispatching network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:37 user nova-compute[70375]: WARNING nova.compute.manager [req-27064e1b-0f2b-4ba6-92dd-ffd20571ab66 req-e17ce37a-9e52-48eb-8ed0-8363500c0254 service nova] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Received unexpected event network-vif-plugged-cc33dfa8-db53-43b9-846b-e8f09e846c71 for instance with vm_state deleted and task_state None.
Jul 24 18:08:37 user nova-compute[70375]: INFO nova.compute.manager [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Rescuing
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG nova.network.neutron [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:38 user nova-compute[70375]: WARNING nova.compute.manager [req-47bf5b85-7eaa-4709-8537-b0422b0dde01 req-e8c6d60f-0e3b-4fb8-9a66-bd91e2e70bc9 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance destroyed successfully.
Jul 24 18:08:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attempting a stable device rescue
Jul 24 18:08:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 18:08:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Creating image(s)
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.part --force-share --output=json" returned: 0 in 0.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.images [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] 00864941-3f68-4d21-aec4-5e972c1c8ceb was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.part /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:40 user nova-compute[70375]: WARNING nova.compute.manager [req-51eb85fa-8411-4ac1-ab21-3e1f72641ea5 req-52efbbc9-e07e-4723-890a-1789df4f7cfc service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.part /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.converted" returned: 0 in 0.393s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.733s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4 --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4,backing_fmt=raw /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4,backing_fmt=raw /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue" returned: 0 in 0.054s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "aa2e42a6b68224bc82a70947f291c8b78f4734d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'migration_context' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start _get_guest_xml network_info=[{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "vif_mac": "fa:16:3e:77:92:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '00864941-3f68-4d21-aec4-5e972c1c8ceb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b2769379-8ee5-4c12-9e09-8a585ed70b6b', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '38b4d478-958e-4355-907d-884f43f9f799', 'attached_at': '', 'detached_at': '', 'volume_id': '5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'serial': '5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'resources' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'numa_topology' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:40 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:08:40 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:40 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:40 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738c082-ce4b-4463-8951-74c0a6f334b8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XQHwLkdx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 18:08:40 user nova-compute[70375]: node.name = iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d
Jul 24 18:08:40 user nova-compute[70375]: node.tpgt = -1
Jul 24 18:08:40 user nova-compute[70375]: node.startup = automatic
Jul 24 18:08:40 user nova-compute[70375]: node.leading_login = No
Jul 24 18:08:40 user nova-compute[70375]: iface.iscsi_ifacename = default
Jul 24 18:08:40 user nova-compute[70375]: iface.net_ifacename = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.ipaddress = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.prefix_len = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.hwaddress = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.transport_name = tcp
Jul 24 18:08:40 user nova-compute[70375]: iface.initiatorname = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.vlan_id = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.vlan_priority = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.vlan_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.iface_num = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.mtu = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.port = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.bootproto = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.subnet_mask = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.gateway = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_alt_client_id = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_dns = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_learn_iqn = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_vendor_id_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_vendor_id = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.dhcp_slp_da = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.fragmentation = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.gratuitous_arp = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.incoming_forwarding = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.tos_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.tos = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.ttl = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.delayed_ack = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.tcp_nagle = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.tcp_wsf_state = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.tcp_wsf = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.tcp_timer_scale = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.tcp_timestamp = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.redirect = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.def_task_mgmt_timeout = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.header_digest = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.data_digest = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.immediate_data = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.initial_r2t = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.data_seq_inorder = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.data_pdu_inorder = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.erl = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.max_receive_data_len = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.first_burst_len = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.max_outstanding_r2t = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.max_burst_len = 0
Jul 24 18:08:40 user nova-compute[70375]: iface.chap_auth = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.bidi_chap = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.strict_login_compliance = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.discovery_auth = <empty>
Jul 24 18:08:40 user nova-compute[70375]: iface.discovery_logout = <empty>
Jul 24 18:08:40 user nova-compute[70375]: node.discovery_address = <empty>
Jul 24 18:08:40 user nova-compute[70375]: node.discovery_port = 0
Jul 24 18:08:40 user nova-compute[70375]: node.discovery_type = static
Jul 24 18:08:40 user nova-compute[70375]: node.session.initial_cmdsn = 0
Jul 24 18:08:40 user nova-compute[70375]: node.session.initial_login_retry_max = 8
Jul 24 18:08:40 user nova-compute[70375]: node.session.xmit_thread_priority = -20
Jul 24 18:08:40 user nova-compute[70375]: node.session.cmds_max = 128
Jul 24 18:08:40 user nova-compute[70375]: node.session.queue_depth = 32
Jul 24 18:08:40 user nova-compute[70375]: node.session.nr_sessions = 1
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.authmethod = CHAP
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.username = XQHwLkdx
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.password = ***
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.username_in = <empty>
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.password_in = <empty>
Jul 24 18:08:40 user nova-compute[70375]: node.session.auth.chap_algs = MD5
Jul 24 18:08:40 user nova-compute[70375]: node.session.timeo.replacement_timeout = 120
Jul 24 18:08:40 user nova-compute[70375]: node.session.err_timeo.abort_timeout = 15
Jul 24 18:08:40 user nova-compute[70375]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 18:08:40 user nova-compute[70375]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 18:08:40 user nova-compute[70375]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.FastAbort = Yes
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.InitialR2T = No
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.ImmediateData = Yes
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.MaxConnections = 1
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 18:08:40 user nova-compute[70375]: node.session.iscsi.ERL = 0
Jul 24 18:08:40 user nova-compute[70375]: node.session.scan = manual
Jul 24 18:08:40 user nova-compute[70375]: node.session.reopen_max = 0
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].address = 172.16.0.220
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].port = 3260
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].startup = manual
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].tcp.window_size = 524288
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].tcp.type_of_service = 0
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].timeo.logout_timeout = 15
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].timeo.login_timeout = 15
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].timeo.auth_timeout = 45
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.DataDigest = None
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.IFMarker = No
Jul 24 18:08:40 user nova-compute[70375]: node.conn[0].iscsi.OFMarker = No
Jul 24 18:08:40 user nova-compute[70375]: # END RECORD
Jul 24 18:08:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9636b-69fc-4bd6-8a3f-9eb87d8fc534]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf277c88-c5d3-4992-89ee-52551e2b1bd4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQHwLkdx {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQHwLkdx" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a076bd9-2c74-49ae-9622-e4da27e4f721]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQHwLkdx'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b5b8c-6dc7-4c62-b5bc-57ec604f3e65]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[58147dec-575c-43d0-b9ac-ff88db6c5239]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:41 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:41 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] HCTL ('33', '0', '0', 0) found on session 46 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d060b-e2de-45c9-8141-c57f99d7b588]: (4, ('0 0 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Searching for a device in session 46 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.160s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] <== connect_volume: return (161ms) {'type': 'block', 'scsi_wwn': '23538636133363561', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538636133363561', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-882395697',display_name='tempest-ServerStableDeviceRescueTest-server-882395697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-882395697',id=33,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcHuHcfaaRB4/AQqnwNqOcQ1K1vm1m9o5CGpOYaaMJiDo+g+pkj8AyLaOZlGLvExJaEKDWMED4Uuzw5Rlil4qLOlJ/kHFW+SSE+GvyqLIIPvv2EqS+jEU0MMOyHbe5t+w==',key_name='tempest-keypair-138371338',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324c7b2c403942d28dfe43d9f6f30644',ramdisk_id='',reservation_id='r-atgmp2n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1383704498',owner_user_name='tempest-ServerStableDeviceRescueTest-1383704498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db18ae70ad59494e9f4c13b122f3ecc9',uuid=38b4d478-958e-4355-907d-884f43f9f799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "vif_mac": "fa:16:3e:77:92:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converting VIF {"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "vif_mac": "fa:16:3e:77:92:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.objects.instance [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'pci_devices' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:08:41 user nova-compute[70375]:   <uuid>38b4d478-958e-4355-907d-884f43f9f799</uuid>
Jul 24 18:08:41 user nova-compute[70375]:   <name>instance-00000021</name>
Jul 24 18:08:41 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:08:41 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:08:41 user nova-compute[70375]:   <metadata>
Jul 24 18:08:41 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:08:41 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-882395697</nova:name>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:08:40</nova:creationTime>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:08:41 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:08:41 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:owner>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:user uuid="db18ae70ad59494e9f4c13b122f3ecc9">tempest-ServerStableDeviceRescueTest-1383704498-project-member</nova:user>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:project uuid="324c7b2c403942d28dfe43d9f6f30644">tempest-ServerStableDeviceRescueTest-1383704498</nova:project>
Jul 24 18:08:41 user nova-compute[70375]:       </nova:owner>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:08:41 user nova-compute[70375]:       <nova:ports>
Jul 24 18:08:41 user nova-compute[70375]:         <nova:port uuid="6f0e720f-2f21-413e-ba70-1f1d7581d414">
Jul 24 18:08:41 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 18:08:41 user nova-compute[70375]:         </nova:port>
Jul 24 18:08:41 user nova-compute[70375]:       </nova:ports>
Jul 24 18:08:41 user nova-compute[70375]:     </nova:instance>
Jul 24 18:08:41 user nova-compute[70375]:   </metadata>
Jul 24 18:08:41 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:08:41 user nova-compute[70375]:     <system>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="serial">38b4d478-958e-4355-907d-884f43f9f799</entry>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="uuid">38b4d478-958e-4355-907d-884f43f9f799</entry>
Jul 24 18:08:41 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:08:41 user nova-compute[70375]:     </system>
Jul 24 18:08:41 user nova-compute[70375]:   </sysinfo>
Jul 24 18:08:41 user nova-compute[70375]:   <os>
Jul 24 18:08:41 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:08:41 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:08:41 user nova-compute[70375]:   </os>
Jul 24 18:08:41 user nova-compute[70375]:   <features>
Jul 24 18:08:41 user nova-compute[70375]:     <acpi/>
Jul 24 18:08:41 user nova-compute[70375]:     <apic/>
Jul 24 18:08:41 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:08:41 user nova-compute[70375]:   </features>
Jul 24 18:08:41 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:08:41 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:08:41 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:08:41 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:08:41 user nova-compute[70375]:   </clock>
Jul 24 18:08:41 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:08:41 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:08:41 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:08:41 user nova-compute[70375]:   </cpu>
Jul 24 18:08:41 user nova-compute[70375]:   <devices>
Jul 24 18:08:41 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:08:41 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:08:41 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk"/>
Jul 24 18:08:41 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:08:41 user nova-compute[70375]:     </disk>
Jul 24 18:08:41 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:08:41 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:08:41 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:08:41 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 18:08:41 user nova-compute[70375]:       <serial>5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d</serial>
Jul 24 18:08:41 user nova-compute[70375]:     </disk>
Jul 24 18:08:41 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:08:41 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:08:41 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue"/>
Jul 24 18:08:41 user nova-compute[70375]:       <target dev="vdc" bus="virtio"/>
Jul 24 18:08:41 user nova-compute[70375]:       <boot order="1"/>
Jul 24 18:08:41 user nova-compute[70375]:     </disk>
Jul 24 18:08:41 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:08:41 user nova-compute[70375]:       <mac address="fa:16:3e:77:92:e7"/>
Jul 24 18:08:41 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:08:41 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:08:41 user nova-compute[70375]:       <target dev="tap6f0e720f-2f"/>
Jul 24 18:08:41 user nova-compute[70375]:     </interface>
Jul 24 18:08:41 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:08:41 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/console.log" append="off"/>
Jul 24 18:08:41 user nova-compute[70375]:     </serial>
Jul 24 18:08:41 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:08:41 user nova-compute[70375]:     <video>
Jul 24 18:08:41 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:08:41 user nova-compute[70375]:     </video>
Jul 24 18:08:41 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:08:41 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:08:41 user nova-compute[70375]:     </rng>
Jul 24 18:08:41 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:08:41 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:08:41 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:08:41 user nova-compute[70375]:     </memballoon>
Jul 24 18:08:41 user nova-compute[70375]:   </devices>
Jul 24 18:08:41 user nova-compute[70375]: </domain>
Jul 24 18:08:41 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:08:41 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance destroyed successfully.
Jul 24 18:08:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] No VIF found with MAC fa:16:3e:77:92:e7, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:08:42 user nova-compute[70375]: INFO nova.compute.manager [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Rescuing
Jul 24 18:08:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating instance_info_cache with network_info: [{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:43 user nova-compute[70375]: WARNING nova.compute.manager [req-b7059dc1-5cda-4bb1-89ba-3e6d015c6c5e req-a1a2b8b5-f6e9-4778-9ab5-29ae628b5b89 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance destroyed successfully.
Jul 24 18:08:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Attempting a stable device rescue
Jul 24 18:08:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70375) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance directory exists: not creating {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 18:08:44 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Creating image(s)
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'trusted_certs' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "08d5fa84fa3c84270e6241e07142a58f02016e24" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "08d5fa84fa3c84270e6241e07142a58f02016e24" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 38b4d478-958e-4355-907d-884f43f9f799 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222124.735186, 38b4d478-958e-4355-907d-884f43f9f799 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:08:45 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Resumed (Lifecycle Event)
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json" returned: 0 in 1.054s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-dae1815b-906a-4e5e-b4e4-8caf71232915 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:08:45 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222124.7357242, 38b4d478-958e-4355-907d-884f43f9f799 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:08:45 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Started (Lifecycle Event)
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.part --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.virt.images [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] 80eefda2-f5f5-428e-9f88-cf85de59bf72 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.part /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:45 user nova-compute[70375]: WARNING nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:45 user nova-compute[70375]: WARNING nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:45 user nova-compute[70375]: WARNING nova.compute.manager [req-e671c8ed-460f-459f-a6e3-10b47da30617 req-da7c0668-ff38-4feb-9bd1-7ec0a8e4f79e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.part /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.converted" returned: 0 in 0.424s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "08d5fa84fa3c84270e6241e07142a58f02016e24" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.850s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "08d5fa84fa3c84270e6241e07142a58f02016e24" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "08d5fa84fa3c84270e6241e07142a58f02016e24" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24 --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24,backing_fmt=raw /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24,backing_fmt=raw /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue" returned: 0 in 0.121s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "08d5fa84fa3c84270e6241e07142a58f02016e24" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'migration_context' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start _get_guest_xml network_info=[{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:e2:df:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '80eefda2-f5f5-428e-9f88-cf85de59bf72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '081bae8e-fd41-4349-b524-2917d27d7b71', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'edf496ee-bac6-4e86-9b16-c8f2f08f93e1', 'attached_at': '', 'detached_at': '', 'volume_id': '2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'serial': '2e50773b-eb3b-463b-a9f1-9f8eaf851c1e'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'numa_topology' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'vcpu_model' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:08:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:46 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6661be-2c5f-4bb7-9902-402ca4effa81]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hZRojqab\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 18:08:46 user nova-compute[70375]: node.name = iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:08:46 user nova-compute[70375]: node.tpgt = -1
Jul 24 18:08:46 user nova-compute[70375]: node.startup = automatic
Jul 24 18:08:46 user nova-compute[70375]: node.leading_login = No
Jul 24 18:08:46 user nova-compute[70375]: iface.iscsi_ifacename = default
Jul 24 18:08:46 user nova-compute[70375]: iface.net_ifacename = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.ipaddress = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.prefix_len = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.hwaddress = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.transport_name = tcp
Jul 24 18:08:46 user nova-compute[70375]: iface.initiatorname = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.vlan_id = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.vlan_priority = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.vlan_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.iface_num = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.mtu = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.port = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.bootproto = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.subnet_mask = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.gateway = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_alt_client_id = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_dns = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_learn_iqn = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_vendor_id_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_vendor_id = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.dhcp_slp_da = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.fragmentation = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.gratuitous_arp = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.incoming_forwarding = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.tos_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.tos = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.ttl = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.delayed_ack = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.tcp_nagle = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.tcp_wsf_state = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.tcp_wsf = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.tcp_timer_scale = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.tcp_timestamp = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.redirect = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.def_task_mgmt_timeout = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.header_digest = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.data_digest = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.immediate_data = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.initial_r2t = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.data_seq_inorder = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.data_pdu_inorder = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.erl = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.max_receive_data_len = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.first_burst_len = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.max_outstanding_r2t = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.max_burst_len = 0
Jul 24 18:08:46 user nova-compute[70375]: iface.chap_auth = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.bidi_chap = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.strict_login_compliance = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.discovery_auth = <empty>
Jul 24 18:08:46 user nova-compute[70375]: iface.discovery_logout = <empty>
Jul 24 18:08:46 user nova-compute[70375]: node.discovery_address = <empty>
Jul 24 18:08:46 user nova-compute[70375]: node.discovery_port = 0
Jul 24 18:08:46 user nova-compute[70375]: node.discovery_type = static
Jul 24 18:08:46 user nova-compute[70375]: node.session.initial_cmdsn = 0
Jul 24 18:08:46 user nova-compute[70375]: node.session.initial_login_retry_max = 8
Jul 24 18:08:46 user nova-compute[70375]: node.session.xmit_thread_priority = -20
Jul 24 18:08:46 user nova-compute[70375]: node.session.cmds_max = 128
Jul 24 18:08:46 user nova-compute[70375]: node.session.queue_depth = 32
Jul 24 18:08:46 user nova-compute[70375]: node.session.nr_sessions = 1
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.authmethod = CHAP
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.username = hZRojqab
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.password = ***
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.username_in = <empty>
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.password_in = <empty>
Jul 24 18:08:46 user nova-compute[70375]: node.session.auth.chap_algs = MD5
Jul 24 18:08:46 user nova-compute[70375]: node.session.timeo.replacement_timeout = 120
Jul 24 18:08:46 user nova-compute[70375]: node.session.err_timeo.abort_timeout = 15
Jul 24 18:08:46 user nova-compute[70375]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 18:08:46 user nova-compute[70375]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 18:08:46 user nova-compute[70375]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.FastAbort = Yes
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.InitialR2T = No
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.ImmediateData = Yes
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.MaxConnections = 1
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 18:08:46 user nova-compute[70375]: node.session.iscsi.ERL = 0
Jul 24 18:08:46 user nova-compute[70375]: node.session.scan = manual
Jul 24 18:08:46 user nova-compute[70375]: node.session.reopen_max = 0
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].address = 172.16.0.220
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].port = 3260
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].startup = manual
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].tcp.window_size = 524288
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].tcp.type_of_service = 0
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].timeo.logout_timeout = 15
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].timeo.login_timeout = 15
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].timeo.auth_timeout = 45
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.DataDigest = None
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.IFMarker = No
Jul 24 18:08:46 user nova-compute[70375]: node.conn[0].iscsi.OFMarker = No
Jul 24 18:08:46 user nova-compute[70375]: # END RECORD
Jul 24 18:08:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd81415-ea56-4478-bd0a-5961f4f190d4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab89d9-10dc-43c5-b51f-d4bbe996b2b1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZRojqab {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZRojqab" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f49618-d201-4611-97d1-73d85b1b3bef]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZRojqab'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa9cde-c4b8-42e6-a57e-24dea5c8d15b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156a1bf-dfbd-4d3f-ac62-248d5457766d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:46 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] HCTL ('36', '0', '0', 0) found on session 44 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b33fca-d85d-4518-9e0c-943e8cb398dd]: (4, ('0 0 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Searching for a device in session 44 and hctl ('36', '0', '0', 0) yield: sde {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '23234626232373331', 'path': '/dev/sde'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626232373331', 'path': '/dev/sde'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-208816579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-208816579',id=36,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:07:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ck8ktxog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:07:10Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=edf496ee-bac6-4e86-9b16-c8f2f08f93e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:e2:df:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "vif_mac": "fa:16:3e:e2:df:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'pci_devices' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:08:46 user nova-compute[70375]:   <uuid>edf496ee-bac6-4e86-9b16-c8f2f08f93e1</uuid>
Jul 24 18:08:46 user nova-compute[70375]:   <name>instance-00000024</name>
Jul 24 18:08:46 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:08:46 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:08:46 user nova-compute[70375]:   <metadata>
Jul 24 18:08:46 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:08:46 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-208816579</nova:name>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:08:46</nova:creationTime>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:08:46 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:08:46 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:owner>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:user uuid="1c1aa740b7404c2e8703488bcd87404d">tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member</nova:user>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:project uuid="0f5a644d007b4ecdbde7ec4788464675">tempest-ServerBootFromVolumeStableRescueTest-616724674</nova:project>
Jul 24 18:08:46 user nova-compute[70375]:       </nova:owner>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:08:46 user nova-compute[70375]:       <nova:ports>
Jul 24 18:08:46 user nova-compute[70375]:         <nova:port uuid="9b539894-c678-4ca9-9c36-e3d23129c922">
Jul 24 18:08:46 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 18:08:46 user nova-compute[70375]:         </nova:port>
Jul 24 18:08:46 user nova-compute[70375]:       </nova:ports>
Jul 24 18:08:46 user nova-compute[70375]:     </nova:instance>
Jul 24 18:08:46 user nova-compute[70375]:   </metadata>
Jul 24 18:08:46 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:08:46 user nova-compute[70375]:     <system>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="serial">edf496ee-bac6-4e86-9b16-c8f2f08f93e1</entry>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="uuid">edf496ee-bac6-4e86-9b16-c8f2f08f93e1</entry>
Jul 24 18:08:46 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:08:46 user nova-compute[70375]:     </system>
Jul 24 18:08:46 user nova-compute[70375]:   </sysinfo>
Jul 24 18:08:46 user nova-compute[70375]:   <os>
Jul 24 18:08:46 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:08:46 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:08:46 user nova-compute[70375]:   </os>
Jul 24 18:08:46 user nova-compute[70375]:   <features>
Jul 24 18:08:46 user nova-compute[70375]:     <acpi/>
Jul 24 18:08:46 user nova-compute[70375]:     <apic/>
Jul 24 18:08:46 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:08:46 user nova-compute[70375]:   </features>
Jul 24 18:08:46 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:08:46 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:08:46 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:08:46 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:08:46 user nova-compute[70375]:   </clock>
Jul 24 18:08:46 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:08:46 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:08:46 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:08:46 user nova-compute[70375]:   </cpu>
Jul 24 18:08:46 user nova-compute[70375]:   <devices>
Jul 24 18:08:46 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:08:46 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:08:46 user nova-compute[70375]:       <source dev="/dev/sde"/>
Jul 24 18:08:46 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:08:46 user nova-compute[70375]:       <serial>2e50773b-eb3b-463b-a9f1-9f8eaf851c1e</serial>
Jul 24 18:08:46 user nova-compute[70375]:     </disk>
Jul 24 18:08:46 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:08:46 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:08:46 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue"/>
Jul 24 18:08:46 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 18:08:46 user nova-compute[70375]:       <boot order="1"/>
Jul 24 18:08:46 user nova-compute[70375]:     </disk>
Jul 24 18:08:46 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:08:46 user nova-compute[70375]:       <mac address="fa:16:3e:e2:df:5a"/>
Jul 24 18:08:46 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:08:46 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:08:46 user nova-compute[70375]:       <target dev="tap9b539894-c6"/>
Jul 24 18:08:46 user nova-compute[70375]:     </interface>
Jul 24 18:08:46 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:08:46 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/console.log" append="off"/>
Jul 24 18:08:46 user nova-compute[70375]:     </serial>
Jul 24 18:08:46 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:08:46 user nova-compute[70375]:     <video>
Jul 24 18:08:46 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:08:46 user nova-compute[70375]:     </video>
Jul 24 18:08:46 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:08:46 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:08:46 user nova-compute[70375]:     </rng>
Jul 24 18:08:46 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:08:46 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:08:46 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:08:46 user nova-compute[70375]:     </memballoon>
Jul 24 18:08:46 user nova-compute[70375]:   </devices>
Jul 24 18:08:46 user nova-compute[70375]: </domain>
Jul 24 18:08:46 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:08:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance destroyed successfully.
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] No VIF found with MAC fa:16:3e:e2:df:5a, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing instance network info cache due to event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:08:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG nova.network.neutron [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updated VIF entry in instance network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG nova.network.neutron [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:48 user nova-compute[70375]: WARNING nova.compute.manager [req-e56dd4aa-5ea3-43ec-a530-8ff326169586 req-52b74664-bd2a-4144-8666-0daf06dce7b0 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e586e3b7-c5c3-4f74-8544-96bebc606eb4 req-9d3dabb2-4f37-40b1-8fa7-0811e2e164a4 service nova] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing instance network info cache due to event network-changed-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] Acquiring lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] Acquired lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Refreshing network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:49 user nova-compute[70375]: INFO nova.compute.manager [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Detaching volume 2f71dc9a-968a-49e5-839c-2662ed645dc6
Jul 24 18:08:49 user nova-compute[70375]: INFO nova.virt.block_device [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Attempting to driver detach volume 2f71dc9a-968a-49e5-839c-2662ed645dc6 from mountpoint /dev/vdb
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Attempting to detach device vdb from instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:08:49 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:08:49 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 18:08:49 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:08:49 user nova-compute[70375]:   <serial>2f71dc9a-968a-49e5-839c-2662ed645dc6</serial>
Jul 24 18:08:49 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:08:49 user nova-compute[70375]: </disk>
Jul 24 18:08:49 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:49 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully detached device vdb from instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 from the persistent domain config.
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:08:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:08:49 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:08:49 user nova-compute[70375]:   <source dev="/dev/sdd"/>
Jul 24 18:08:49 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:08:49 user nova-compute[70375]:   <serial>2f71dc9a-968a-49e5-839c-2662ed645dc6</serial>
Jul 24 18:08:49 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:08:49 user nova-compute[70375]: </disk>
Jul 24 18:08:49 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690222129.9360805, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222115.7636063, 9228b8cf-e00a-4a57-9762-3e9063199d63 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:08:50 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] VM Stopped (Lifecycle Event)
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for edf496ee-bac6-4e86-9b16-c8f2f08f93e1 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222130.6207497, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:08:50 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Resumed (Lifecycle Event)
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:08:50 user nova-compute[70375]: WARNING nova.compute.manager [req-d784d328-b648-4f8e-8cf3-1e0f8babebf0 req-9a85a415-35c6-41aa-9a23-c2619a28f820 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state rescuing.
Jul 24 18:08:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully detached device vdb from instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 from the live domain config.
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-43c7d98f-de55-4d24-b636-704a9ad36725 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PieWkqaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:08:50 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-0a1c9378-6d1b-474a-a1ee-c3dee8e0bd06 None None] [instance: 9228b8cf-e00a-4a57-9762-3e9063199d63] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=23.94167709350586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2c726f-0e29-45a8-ae35-c584551caebe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:08:50 user nova-compute[70375]: No targets found.
Jul 24 18:08:50 user nova-compute[70375]: iSNS:
Jul 24 18:08:50 user nova-compute[70375]: No targets found.
Jul 24 18:08:50 user nova-compute[70375]: STATIC:
Jul 24 18:08:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:08:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:08:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:08:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6
Jul 24 18:08:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:08:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:08:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d
Jul 24 18:08:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:08:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:08:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463
Jul 24 18:08:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:08:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:08:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:08:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:08:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:08:50 user nova-compute[70375]: FIRMWARE:
Jul 24 18:08:50 user nova-compute[70375]: No targets found.
Jul 24 18:08:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:08:50 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:08:50 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56dda5a-7e54-409a-b3d3-530f57deaeb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:50 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222130.6244552, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:08:50 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Started (Lifecycle Event)
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a134eb4-c30a-4d76-b03e-9893195a6218]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:08:50 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:08:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6481f2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.network.neutron [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updated VIF entry in instance network info cache for port 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.network.neutron [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [{"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d896f64-3206-4904-a77d-7fa1274f0e71]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-650a43ad-156d-4608-91e0-93d3ec777c9a req-1737043b-ac82-47c5-9a94-0a603bf0adca service nova] Releasing lock "refresh_cache-8a10387a-c571-4b26-bbbf-8b86b12ffcc1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bbe2e0-1406-4d8b-82c0-eb66653312f4]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[11927038-c8ce-4b18-8275-e5ff749eb937]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f784c-ff1a-45ed-bb4e-6aa526803b42]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[532dcffe-97b9-449b-bcae-137c835c15bf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9b6f5a7b-cce7-4693-8bbf-c03628574639 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 279e06b7-babd-4740-b91a-e01d432720d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c04952-14d8-4c72-8cae-063deb102979]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260]
Jul 24 18:08:51 user nova-compute[70375]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6, portal: 172.16.0.220,3260] successful.
Jul 24 18:08:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f71dc9a-968a-49e5-839c-2662ed645dc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798af1f-3ab1-4440-b8c1-1101eb1f698c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] <== disconnect_volume: return (389ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:08:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:08:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:08:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'flavor' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:08:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1bd047fb-b78c-4f63-97c6-da9af6b2b82f tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.114s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:08:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:09:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-changed-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Refreshing instance network info cache due to event network-changed-72f7de7c-535c-4a4d-bf67-7574132c87cf. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] Acquiring lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] Acquired lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Refreshing network info cache for port 72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updated VIF entry in instance network info cache for port 72f7de7c-535c-4a4d-bf67-7574132c87cf. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updating instance_info_cache with network_info: [{"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d7d175a0-0947-445c-96c5-26d5590e22a6 req-ba29b28b-5595-4cfd-81a2-59274d0ca4ff service nova] Releasing lock "refresh_cache-9b6f5a7b-cce7-4693-8bbf-c03628574639" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:09:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:09 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:09:09 user nova-compute[70375]: INFO nova.compute.claims [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Claim successful on node user
Jul 24 18:09:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:09:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:09:10 user nova-compute[70375]: INFO nova.virt.block_device [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Booting with volume snapshot 0e3bb3fb-4812-41a9-a79a-f34aabfb8578 at /dev/vda
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.policy [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Successfully created port: 4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:09:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Successfully updated port: 4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-changed-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.compute.manager [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Refreshing instance network info cache due to event network-changed-4ce9e8a7-16e1-418c-9034-607abee8c11a. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] Acquiring lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating instance_info_cache with network_info: [{"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Instance network_info: |[{"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] Acquired lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Refreshing network info cache for port 4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updated VIF entry in instance network info cache for port 4ce9e8a7-16e1-418c-9034-607abee8c11a. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG nova.network.neutron [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating instance_info_cache with network_info: [{"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-46f32d15-4b76-49f6-9280-0bc9ae0571bd req-15ec17ec-ede9-4dd8-9016-e41638f3247b service nova] Releasing lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.utils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a430f3dd-47c6-431b-95aa-68e5114ab280]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d8cc36-dcb5-475a-8542-82bc94811efd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b41efa-1528-496f-8997-87027c518cd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881ce79-ea16-43dc-ba83-4689c0a3e400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:09:15 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:09:15 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[14933f8f-236a-46bb-8f68-1a2034d1438f]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG os_brick.utils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:09:15 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating existing volume attachment record: 0f32411d-845d-43bb-bca9-e621e7ebd64b {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:09:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:20 user nova-compute[70375]: INFO nova.compute.manager [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Terminating instance
Jul 24 18:09:20 user nova-compute[70375]: DEBUG nova.compute.manager [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-unplugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] No waiting events found dispatching network-vif-unplugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-d387f795-daa4-44ee-938b-434ad5e47f79 req-fefb3554-280c-46da-90a0-bfe5540c991c service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-unplugged-d43d8b2e-8035-4231-a01b-c855a33942ea for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Instance destroyed successfully.
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.objects.instance [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'resources' on Instance uuid 279e06b7-babd-4740-b91a-e01d432720d5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284757743',display_name='tempest-ServersNegativeTestJSON-server-284757743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284757743',id=38,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-6n73ms1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:07:37Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=279e06b7-babd-4740-b91a-e01d432720d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "d43d8b2e-8035-4231-a01b-c855a33942ea", "address": "fa:16:3e:a5:17:d2", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43d8b2e-80", "ovs_interfaceid": "d43d8b2e-8035-4231-a01b-c855a33942ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG os_vif [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd43d8b2e-80, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:09:21 user nova-compute[70375]: INFO os_vif [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:17:d2,bridge_name='br-int',has_traffic_filtering=True,id=d43d8b2e-8035-4231-a01b-c855a33942ea,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43d8b2e-80')
Jul 24 18:09:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Deleting instance files /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5_del
Jul 24 18:09:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Deletion of /opt/stack/data/nova/instances/279e06b7-babd-4740-b91a-e01d432720d5_del complete
Jul 24 18:09:21 user nova-compute[70375]: INFO nova.compute.manager [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 18:09:21 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:09:21 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:22 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Took 0.49 seconds to deallocate network for instance.
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:09:22 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Creating image(s)
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Ensure instance console log exists: /opt/stack/data/nova/instances/a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Start _get_guest_xml network_info=[{"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T18:09:03Z,direct_url=<?>,disk_format='qcow2',id=ef62538e-2a22-48cf-8951-243111458ece,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-693913899',owner='e31b27038d1342519b6660f16785bbaa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T18:09:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0f32411d-845d-43bb-bca9-e621e7ebd64b', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPbLTxVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94', 'attached_at': '', 'detached_at': '', 'volume_id': '664b5404-55d9-44c7-9944-eb9bb9a2b2da', 'serial': '664b5404-55d9-44c7-9944-eb9bb9a2b2da'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:09:22 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:09:22 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T18:09:03Z,direct_url=<?>,disk_format='qcow2',id=ef62538e-2a22-48cf-8951-243111458ece,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-693913899',owner='e31b27038d1342519b6660f16785bbaa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T18:09:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPbLTxVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:09:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:09:22 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:09:22 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66404990-f8c2-4ef5-b299-aaeeb8a5af54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:09:22 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[751661b6-47a0-490b-adad-61cbaf13bb43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da] added
Jul 24 18:09:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[283593bc-6794-4002-b9ba-e580b352eede]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c1b2b-6efa-4305-aadb-dd959e3e715f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPbLTxVe {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPbLTxVe" returned: 0 in 0.029s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[042dd529-6669-49b1-8b02-6d39cf37849d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lPbLTxVe'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e7c68-756b-4017-b16c-6d58d53b42ad]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Deleted allocations for instance 279e06b7-babd-4740-b91a-e01d432720d5
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae1db67-b263-4533-8e63-63df33202b20]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:09:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:09:22 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:09:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-90db9d3e-901a-4af3-aa3c-20c58a1e09ed tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "279e06b7-babd-4740-b91a-e01d432720d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a43170-a0b2-467c-a28d-1111e67ccb19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260]
Jul 24 18:09:22 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260] successful.
Jul 24 18:09:22 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259156b-e344-4373-9807-93cc2806ff07]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee9a401-f632-4f46-b0d0-31e09f500430]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)
Jul 24 18:09:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:09:23 user nova-compute[70375]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)
Jul 24 18:09:23 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7252e49-84ff-4085-b3ec-4a1032dc98c7]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] Acquiring lock "279e06b7-babd-4740-b91a-e01d432720d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] Lock "279e06b7-babd-4740-b91a-e01d432720d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] No waiting events found dispatching network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:23 user nova-compute[70375]: WARNING nova.compute.manager [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received unexpected event network-vif-plugged-d43d8b2e-8035-4231-a01b-c855a33942ea for instance with vm_state deleted and task_state None.
Jul 24 18:09:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-ab5d7654-c6ad-4c82-b6a5-3d6a5245f1a9 req-76635011-ec27-42d1-aad7-23350ead20b7 service nova] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Received event network-vif-deleted-d43d8b2e-8035-4231-a01b-c855a33942ea {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPbLTxVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23432346538373533', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432346538373533', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-927508117',id=39,image_ref='ef62538e-2a22-48cf-8951-243111458ece',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxmVg+WuFT1Mrg6usnISw6CALlGGtNE0b77fFPsCaDHxltnJmvn0BAygqjL2Y7pyFZJVnjbyW90WsKE8av8mYBKoJellqHEr6+i55ptoLK5phVqPtwGqLAtJ7YB0alJkA==',key_name='tempest-keypair-606371955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-qnc22mnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-728863810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.objects.instance [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:09:24 user nova-compute[70375]:   <uuid>a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94</uuid>
Jul 24 18:09:24 user nova-compute[70375]:   <name>instance-00000027</name>
Jul 24 18:09:24 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:09:24 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:09:24 user nova-compute[70375]:   <metadata>
Jul 24 18:09:24 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:09:24 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-927508117</nova:name>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:09:22</nova:creationTime>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:09:24 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:09:24 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:owner>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:09:24 user nova-compute[70375]:       </nova:owner>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:root type="image" uuid="ef62538e-2a22-48cf-8951-243111458ece"/>
Jul 24 18:09:24 user nova-compute[70375]:       <nova:ports>
Jul 24 18:09:24 user nova-compute[70375]:         <nova:port uuid="4ce9e8a7-16e1-418c-9034-607abee8c11a">
Jul 24 18:09:24 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 18:09:24 user nova-compute[70375]:         </nova:port>
Jul 24 18:09:24 user nova-compute[70375]:       </nova:ports>
Jul 24 18:09:24 user nova-compute[70375]:     </nova:instance>
Jul 24 18:09:24 user nova-compute[70375]:   </metadata>
Jul 24 18:09:24 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:09:24 user nova-compute[70375]:     <system>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="serial">a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94</entry>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="uuid">a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94</entry>
Jul 24 18:09:24 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:09:24 user nova-compute[70375]:     </system>
Jul 24 18:09:24 user nova-compute[70375]:   </sysinfo>
Jul 24 18:09:24 user nova-compute[70375]:   <os>
Jul 24 18:09:24 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:09:24 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:09:24 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:09:24 user nova-compute[70375]:   </os>
Jul 24 18:09:24 user nova-compute[70375]:   <features>
Jul 24 18:09:24 user nova-compute[70375]:     <acpi/>
Jul 24 18:09:24 user nova-compute[70375]:     <apic/>
Jul 24 18:09:24 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:09:24 user nova-compute[70375]:   </features>
Jul 24 18:09:24 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:09:24 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:09:24 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:09:24 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:09:24 user nova-compute[70375]:   </clock>
Jul 24 18:09:24 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:09:24 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:09:24 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:09:24 user nova-compute[70375]:   </cpu>
Jul 24 18:09:24 user nova-compute[70375]:   <devices>
Jul 24 18:09:24 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:09:24 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:09:24 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 18:09:24 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:09:24 user nova-compute[70375]:       <serial>664b5404-55d9-44c7-9944-eb9bb9a2b2da</serial>
Jul 24 18:09:24 user nova-compute[70375]:     </disk>
Jul 24 18:09:24 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:09:24 user nova-compute[70375]:       <mac address="fa:16:3e:a2:d1:fc"/>
Jul 24 18:09:24 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:09:24 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:09:24 user nova-compute[70375]:       <target dev="tap4ce9e8a7-16"/>
Jul 24 18:09:24 user nova-compute[70375]:     </interface>
Jul 24 18:09:24 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:09:24 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94/console.log" append="off"/>
Jul 24 18:09:24 user nova-compute[70375]:     </serial>
Jul 24 18:09:24 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:09:24 user nova-compute[70375]:     <video>
Jul 24 18:09:24 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:09:24 user nova-compute[70375]:     </video>
Jul 24 18:09:24 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:09:24 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:09:24 user nova-compute[70375]:     </rng>
Jul 24 18:09:24 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:09:24 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:09:24 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:09:24 user nova-compute[70375]:     </memballoon>
Jul 24 18:09:24 user nova-compute[70375]:   </devices>
Jul 24 18:09:24 user nova-compute[70375]: </domain>
Jul 24 18:09:24 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-927508117',id=39,image_ref='ef62538e-2a22-48cf-8951-243111458ece',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxmVg+WuFT1Mrg6usnISw6CALlGGtNE0b77fFPsCaDHxltnJmvn0BAygqjL2Y7pyFZJVnjbyW90WsKE8av8mYBKoJellqHEr6+i55ptoLK5phVqPtwGqLAtJ7YB0alJkA==',key_name='tempest-keypair-606371955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-qnc22mnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-728863810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG os_vif [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ce9e8a7-16, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ce9e8a7-16, col_values=(('external_ids', {'iface-id': '4ce9e8a7-16e1-418c-9034-607abee8c11a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d1:fc', 'vm-uuid': 'a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:24 user nova-compute[70375]: INFO os_vif [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16')
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:09:24 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:a2:d1:fc, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] No waiting events found dispatching network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:25 user nova-compute[70375]: WARNING nova.compute.manager [req-7b6ce842-1488-4697-bf07-3289593a4250 req-724a32c2-f5ba-418e-ab75-837bb45b79e4 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received unexpected event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a for instance with vm_state building and task_state spawning.
Jul 24 18:09:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] No waiting events found dispatching network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:27 user nova-compute[70375]: WARNING nova.compute.manager [req-7bbbd941-b1d6-4049-bed1-e0f3d916e83d req-ce5479e2-8b53-4822-83a9-0da997539be2 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received unexpected event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a for instance with vm_state building and task_state spawning.
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222167.890824, a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] VM Resumed (Lifecycle Event)
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Instance spawned successfully.
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222167.8922772, a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] VM Started (Lifecycle Event)
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Took 5.37 seconds to spawn the instance on the hypervisor.
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:09:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:09:27 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:09:28 user nova-compute[70375]: INFO nova.compute.manager [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Took 18.45 seconds to build instance.
Jul 24 18:09:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6f144ce3-bb34-4899-9149-b068c36c01bd tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.569s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:31 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:32 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222161.7409503, 279e06b7-babd-4740-b91a-e01d432720d5 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:09:36 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] VM Stopped (Lifecycle Event)
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f08dd656-882e-4f68-99f3-f90e54f3343e None None] [instance: 279e06b7-babd-4740-b91a-e01d432720d5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:09:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:09:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:09:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:44 user nova-compute[70375]: INFO nova.compute.manager [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Terminating instance
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-e05f6b34-73f9-47dd-a747-8f57a01e9bb4 req-31077b4c-97a9-4b37-8424-787700e3301d service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-unplugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Instance destroyed successfully.
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lazy-loading 'resources' on Instance uuid 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-563369589',display_name='tempest-TestMinimumBasicScenario-server-563369589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-563369589',id=34,image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoR8yRp0rQf2sIeTezTZ1YFyFl1bTJBD/PS8eN26fMj9Ms49Hoo7HFqmkwHazjmjjv3va/SdMqAx2CjCFLlasnnxRpyDTF0i6IOdgNSuttOqeZtVm/tp4puiPNSo6g7LA==',key_name='tempest-TestMinimumBasicScenario-1482626662',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a342f080683d45b29897f8bf407de037',ramdisk_id='',reservation_id='r-mb4g543g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b51bdd0-60f5-4cf2-af13-41837431b960',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1073066154',owner_user_name='tempest-TestMinimumBasicScenario-1073066154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:07:03Z,user_data=None,user_id='2c5063436895467ca5ffae12856a1677',uuid=8a10387a-c571-4b26-bbbf-8b86b12ffcc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converting VIF {"id": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "address": "fa:16:3e:1e:30:2b", "network": {"id": "13ff6102-e593-4080-a1d6-5a43c61b9326", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-267303107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a342f080683d45b29897f8bf407de037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfc7bcd-35", "ovs_interfaceid": "7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG os_vif [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cfc7bcd-35, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:44 user nova-compute[70375]: INFO os_vif [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:30:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d,network=Network(13ff6102-e593-4080-a1d6-5a43c61b9326),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cfc7bcd-35')
Jul 24 18:09:44 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Deleting instance files /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1_del
Jul 24 18:09:44 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Deletion of /opt/stack/data/nova/instances/8a10387a-c571-4b26-bbbf-8b86b12ffcc1_del complete
Jul 24 18:09:45 user nova-compute[70375]: INFO nova.compute.manager [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-2f35e761-65a4-4714-8129-9b741f39dd9a req-3f65bf81-9956-42d7-867a-f40e55e76355 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-deleted-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:45 user nova-compute[70375]: INFO nova.compute.manager [req-2f35e761-65a4-4714-8129-9b741f39dd9a req-3f65bf81-9956-42d7-867a-f40e55e76355 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Neutron deleted interface 7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d; detaching it from the instance and deleting it from the info cache
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-2f35e761-65a4-4714-8129-9b741f39dd9a req-3f65bf81-9956-42d7-867a-f40e55e76355 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:09:45 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Took 0.88 seconds to deallocate network for instance.
Jul 24 18:09:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-2f35e761-65a4-4714-8129-9b741f39dd9a req-3f65bf81-9956-42d7-867a-f40e55e76355 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Detach interface failed, port_id=7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d, reason: Instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid '8a10387a-c571-4b26-bbbf-8b86b12ffcc1' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid '8a10387a-c571-4b26-bbbf-8b86b12ffcc1' (instance-00000022)
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:46 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Deleted allocations for instance 8a10387a-c571-4b26-bbbf-8b86b12ffcc1
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] Acquiring lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] No waiting events found dispatching network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:09:46 user nova-compute[70375]: WARNING nova.compute.manager [req-8251cb99-e4f3-432d-97e6-071486e5793a req-e2404748-048b-4d77-84d4-b66c96cb7931 service nova] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Received unexpected event network-vif-plugged-7cfc7bcd-3571-48f5-9fe0-d9c8331fa05d for instance with vm_state deleted and task_state None.
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f632364d-3dcb-4fd0-b342-caad78d82448 tempest-TestMinimumBasicScenario-1073066154 tempest-TestMinimumBasicScenario-1073066154-project-member] Lock "8a10387a-c571-4b26-bbbf-8b86b12ffcc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:09:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:09:47 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:09:47 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7737MB free_disk=23.868568420410156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9b6f5a7b-cce7-4693-8bbf-c03628574639 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:09:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:09:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:09:59 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222184.9438987, 8a10387a-c571-4b26-bbbf-8b86b12ffcc1 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:09:59 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] VM Stopped (Lifecycle Event)
Jul 24 18:09:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3f25e3e9-3a7f-4298-bb83-ca39f2f1ffb4 None None] [instance: 8a10387a-c571-4b26-bbbf-8b86b12ffcc1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:09:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:10:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:10:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:28 user nova-compute[70375]: INFO nova.compute.manager [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Unrescuing
Jul 24 18:10:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:10:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:10:28 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG nova.objects.instance [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'flavor' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing instance network info cache due to event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:10:29 user nova-compute[70375]: DEBUG nova.network.neutron [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:10:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance destroyed successfully.
Jul 24 18:10:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updated VIF entry in instance network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:10:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:10:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-39bcef39-772b-4ff9-9ff3-50369fb0718c req-01d30ce1-5a28-45c0-b308-7a88ea210d3f service nova] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing instance network info cache due to event network-changed-6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Acquiring lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Acquired lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:10:31 user nova-compute[70375]: DEBUG nova.network.neutron [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Refreshing network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updated VIF entry in instance network info cache for port 6f0e720f-2f21-413e-ba70-1f1d7581d414. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.network.neutron [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [{"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Releasing lock "refresh_cache-38b4d478-958e-4355-907d-884f43f9f799" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:32 user nova-compute[70375]: WARNING nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:32 user nova-compute[70375]: WARNING nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:32 user nova-compute[70375]: WARNING nova.compute.manager [req-ad033554-3378-4469-8046-b33fa95ccf49 req-05695b16-5a9f-4c6d-b76b-e1b8f9da072d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:33 user nova-compute[70375]: INFO nova.compute.manager [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Unrescuing
Jul 24 18:10:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquired lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.network.neutron [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating instance_info_cache with network_info: [{"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Releasing lock "refresh_cache-edf496ee-bac6-4e86-9b16-c8f2f08f93e1" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'flavor' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for 38b4d478-958e-4355-907d-884f43f9f799 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222233.8196752, 38b4d478-958e-4355-907d-884f43f9f799 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:10:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Resumed (Lifecycle Event)
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6bc66420-b535-4c33-b681-9dc27839c1d4 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222233.820554, 38b4d478-958e-4355-907d-884f43f9f799 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:10:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Started (Lifecycle Event)
Jul 24 18:10:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:34 user nova-compute[70375]: WARNING nova.compute.manager [req-63b713ba-54a9-4f2e-9663-47ad79516400 req-8c296d30-0c1b-4a2f-840f-40a2e1cc7352 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state active and task_state None.
Jul 24 18:10:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance destroyed successfully.
Jul 24 18:10:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:36 user nova-compute[70375]: WARNING nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:36 user nova-compute[70375]: WARNING nova.compute.manager [req-d2151ec1-b234-4d0b-ac8b-db3ed04a1827 req-8598e2ae-76ea-4258-b583-0ad0e3243027 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:10:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:38 user nova-compute[70375]: WARNING nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:10:38 user nova-compute[70375]: WARNING nova.compute.manager [req-799d9c28-90bd-4bda-af4f-d16fd6682e73 req-ddcd7314-dd40-4ff9-9273-56948e54bed4 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state rescued and task_state unrescuing.
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Removed pending event for edf496ee-bac6-4e86-9b16-c8f2f08f93e1 due to event {{(pid=70375) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222238.3596208, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:10:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Resumed (Lifecycle Event)
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-50629c58-cd2c-42e3-b0f1-8126f90e19cf tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:10:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222238.3747418, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:10:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Started (Lifecycle Event)
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:10:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:10:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:10:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:10:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:10:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:10:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7951MB free_disk=23.926490783691406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9b6f5a7b-cce7-4693-8bbf-c03628574639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:10:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:10:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:10:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-changed-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Refreshing instance network info cache due to event network-changed-4ce9e8a7-16e1-418c-9034-607abee8c11a. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] Acquiring lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] Acquired lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:11:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Refreshing network info cache for port 4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updated VIF entry in instance network info cache for port 4ce9e8a7-16e1-418c-9034-607abee8c11a. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating instance_info_cache with network_info: [{"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-18651db9-e942-4567-bb88-aa19ad8073cb req-76cbeed3-9108-47ca-851b-3fec9438751c service nova] Releasing lock "refresh_cache-a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:01 user nova-compute[70375]: INFO nova.compute.manager [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Terminating instance
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-unplugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] No waiting events found dispatching network-vif-unplugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-115257b0-1f2e-49d1-9a79-d49da0a85bf0 req-800a55e8-f94c-4e67-8b64-e027ebf4ce57 service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-unplugged-4ce9e8a7-16e1-418c-9034-607abee8c11a for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:01 user nova-compute[70375]: INFO nova.compute.manager [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Detaching volume 5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.block_device [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Attempting to driver detach volume 5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d from mountpoint /dev/vdb
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Attempting to detach device vdb from instance 38b4d478-958e-4355-907d-884f43f9f799 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:11:02 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:11:02 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:11:02 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:11:02 user nova-compute[70375]:   <serial>5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d</serial>
Jul 24 18:11:02 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:11:02 user nova-compute[70375]: </disk>
Jul 24 18:11:02 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Successfully detached device vdb from instance 38b4d478-958e-4355-907d-884f43f9f799 from the persistent domain config.
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38b4d478-958e-4355-907d-884f43f9f799 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:11:02 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:11:02 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:11:02 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:11:02 user nova-compute[70375]:   <serial>5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d</serial>
Jul 24 18:11:02 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:11:02 user nova-compute[70375]: </disk>
Jul 24 18:11:02 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Instance destroyed successfully.
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-927508117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-927508117',id=39,image_ref='ef62538e-2a22-48cf-8951-243111458ece',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxmVg+WuFT1Mrg6usnISw6CALlGGtNE0b77fFPsCaDHxltnJmvn0BAygqjL2Y7pyFZJVnjbyW90WsKE8av8mYBKoJellqHEr6+i55ptoLK5phVqPtwGqLAtJ7YB0alJkA==',key_name='tempest-keypair-606371955',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-qnc22mnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-728863810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "address": "fa:16:3e:a2:d1:fc", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce9e8a7-16", "ovs_interfaceid": "4ce9e8a7-16e1-418c-9034-607abee8c11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_vif [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ce9e8a7-16, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:11:02 user nova-compute[70375]: INFO os_vif [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=4ce9e8a7-16e1-418c-9034-607abee8c11a,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce9e8a7-16')
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPbLTxVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:11:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67416645-0dbc-48dd-adcb-66ff83cfe00a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]: iSNS:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]: STATIC:
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: FIRMWARE:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:11:02 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:11:02 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88dc6f4-533a-4859-a949-d90fc44b928c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8de0ba-0cac-4ddd-8464-1bfdd9997119]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da (non-flash)
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630328ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a97d2-e8d5-4e2c-b29d-2ab51c30479e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5d53ee-634b-41d7-84d2-d2234d93ebb0]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b36ffae-b6af-447d-8e29-21a3c22a35ad]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6471a-4a58-409b-a762-ed61938b766c]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a5687-5b45-4f70-9943-74a2f53efce0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690222262.4670644, 38b4d478-958e-4355-907d-884f43f9f799 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Successfully detached device vdb from instance 38b4d478-958e-4355-907d-884f43f9f799 from the live domain config.
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQHwLkdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:11:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c09f05f-4cf9-40c1-af13-781c60753752]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260]
Jul 24 18:11:02 user nova-compute[70375]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da, portal: 172.16.0.220,3260] successful.
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:664b5404-55d9-44c7-9944-eb9bb9a2b2da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e42425c-7ab4-44a3-a792-075f25d6b6ab]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (361ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Deleting instance files /opt/stack/data/nova/instances/a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94_del
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Deletion of /opt/stack/data/nova/instances/a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94_del complete
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.058s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[090674bf-d248-494c-9b60-ff2c93956100]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]: iSNS:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]: STATIC:
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:11:02 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:02 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:02 user nova-compute[70375]: FIRMWARE:
Jul 24 18:11:02 user nova-compute[70375]: No targets found.
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:11:02 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:11:02 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a242271-f49a-4ef4-b8a6-afd62305970a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: INFO nova.compute.manager [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b80710-4fa9-43e3-8fc6-9bff3f1312e4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:02 user nova-compute[70375]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d (non-flash)
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6304223b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f502c27-5078-4f39-995a-0f9f72e52149]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5a390-0da4-4f70-93d4-38117d3cd446]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b403e7-614f-41db-8fd0-d68911c2f8d4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a444cb-7e5a-4a25-8373-357fce555356]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357f7f9-6b5b-4ed8-868c-6864ac4d4f82]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c07f89-19b7-4b6b-8d45-993ca0185f27]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260]
Jul 24 18:11:02 user nova-compute[70375]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d, portal: 172.16.0.220,3260] successful.
Jul 24 18:11:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c9be9a6-aad3-4d2f-8da2-da00cd3ac83d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[847407df-ac77-43dc-8fc7-d2a4380d4839]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] <== disconnect_volume: return (384ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:11:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:03 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Took 0.81 seconds to deallocate network for instance.
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6435004e-7e1b-4400-b90d-07ac87f751a2 req-6a6e5309-df06-49a4-a1a2-62e06e9486df service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-deleted-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:03 user nova-compute[70375]: INFO nova.compute.manager [req-6435004e-7e1b-4400-b90d-07ac87f751a2 req-6a6e5309-df06-49a4-a1a2-62e06e9486df service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Neutron deleted interface 4ce9e8a7-16e1-418c-9034-607abee8c11a; detaching it from the instance and deleting it from the info cache
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-6435004e-7e1b-4400-b90d-07ac87f751a2 req-6a6e5309-df06-49a4-a1a2-62e06e9486df service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-6435004e-7e1b-4400-b90d-07ac87f751a2 req-6a6e5309-df06-49a4-a1a2-62e06e9486df service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Detach interface failed, port_id=4ce9e8a7-16e1-418c-9034-607abee8c11a, reason: Instance a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'flavor' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3787ffe4-f995-4925-af41-5a753e37bb0a tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] Acquiring lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] No waiting events found dispatching network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:03 user nova-compute[70375]: WARNING nova.compute.manager [req-d2faed83-ed61-4b06-af11-6b52ec9e94d0 req-d6cd0e57-6c2c-4021-9007-24c2d5bb703c service nova] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Received unexpected event network-vif-plugged-4ce9e8a7-16e1-418c-9034-607abee8c11a for instance with vm_state active and task_state deleting.
Jul 24 18:11:06 user nova-compute[70375]: INFO nova.compute.manager [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Took 2.73 seconds to detach 1 volumes for instance.
Jul 24 18:11:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Deleting volume: 664b5404-55d9-44c7-9944-eb9bb9a2b2da {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:11:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:06 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94
Jul 24 18:11:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f6af8ee-fb45-466b-b5f6-a2dc8a97e434 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.356s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:08 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:11:08 user nova-compute[70375]: INFO nova.compute.claims [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Claim successful on node user
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:11:09 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.policy [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67e8bd01c81943eea6f2b9832b0de6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f662a5b1ca8a47c29d28166c88f1b367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:11:09 user nova-compute[70375]: INFO nova.virt.block_device [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Booting with volume e228107b-8660-4388-bbf5-5908a34e12f3 at /dev/vda
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.utils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a55901c-7794-4f07-8f10-d3f113106d1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb574f-e105-49d3-b3e5-9574f42dcd59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75703d0-a28c-4934-833c-62845cef605e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e9a04-a1fe-420f-84a8-c0472e38b1e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:11:09 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:11:09 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf13d1c-e345-4678-9a67-ff515a5fcbdd]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG os_brick.utils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:11:09 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating existing volume attachment record: c5c9f951-e209-44dd-80f9-ce847c55d098 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Successfully created port: 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Successfully updated port: 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing instance network info cache due to event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:11:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance network_info: |[{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG nova.network.neutron [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG nova.network.neutron [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated VIF entry in instance network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG nova.network.neutron [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3c30c20d-ea99-4e34-a518-3782c0dd59cf req-c70a3c94-6906-472e-9a4f-7564a78f05a8 service nova] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:11:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:11:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Creating image(s)
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Ensure instance console log exists: /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start _get_guest_xml network_info=[{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c5c9f951-e209-44dd-80f9-ce847c55d098', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36962cd1-8583-4e95-99a2-f9348a02fa13', 'attached_at': '', 'detached_at': '', 'volume_id': 'e228107b-8660-4388-bbf5-5908a34e12f3', 'serial': 'e228107b-8660-4388-bbf5-5908a34e12f3'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:11:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:11:16 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:11:16 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:11:16 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:11:16 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95ea000-11d1-408c-b1cb-2368321b5d4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:11:16 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[19482d16-8dca-44c0-ad46-de289bee3eec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3] added
Jul 24 18:11:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1167c08a-c470-49fc-900d-f3a50c97509d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[63011925-6316-4e04-a583-bf0e812d9854]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwmhcAlI {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwmhcAlI" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a265a-5096-4dea-b222-1f6721320fed]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TwmhcAlI'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a99ac50-46f2-4437-82f3-c92d7b631d29]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13492815-d6f4-4b9d-9d02-36bdacbcf54d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:16 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:16 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:16 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:16 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:16 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2417276-50db-4468-aa1d-7886ebdb7282]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]
Jul 24 18:11:17 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.
Jul 24 18:11:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dc2684-217c-41a7-b84d-9a338e084985]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf03ca56-c8cb-497e-b60a-ac33a3b9d065]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:11:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7937a-77b6-4d5d-8ec9-d39e5787bbdd]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222262.1048946, a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:11:17 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] VM Stopped (Lifecycle Event)
Jul 24 18:11:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a41b45e2-6f66-4ad2-88d2-03a32035caae None None] [instance: a4614b0e-5c55-41d2-bbc2-8d2ca5ab2c94] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:11:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23930356230373966', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930356230373966', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZbHjMQTEpcm2PnfEBNF2Te0+DVtjCpZ3qvnIb5pGOdeOvMhLwk9tUOIvFPtiFZcCzK0a0/kGk4VRG2qa25LLD315t/IH+Yv8Utcufm7ArLKVyQsy2RrFPatFdUoTBXA==',key_name='tempest-TestShelveInstance-1849990656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:11:09Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.objects.instance [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'pci_devices' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:11:18 user nova-compute[70375]:   <uuid>36962cd1-8583-4e95-99a2-f9348a02fa13</uuid>
Jul 24 18:11:18 user nova-compute[70375]:   <name>instance-00000028</name>
Jul 24 18:11:18 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:11:18 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:11:18 user nova-compute[70375]:   <metadata>
Jul 24 18:11:18 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:11:18 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:11:18 user nova-compute[70375]:       <nova:name>tempest-TestShelveInstance-server-331062950</nova:name>
Jul 24 18:11:18 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:11:16</nova:creationTime>
Jul 24 18:11:18 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:11:18 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:11:18 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:11:18 user nova-compute[70375]:       <nova:owner>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:user uuid="67e8bd01c81943eea6f2b9832b0de6f9">tempest-TestShelveInstance-1919161037-project-member</nova:user>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:project uuid="f662a5b1ca8a47c29d28166c88f1b367">tempest-TestShelveInstance-1919161037</nova:project>
Jul 24 18:11:18 user nova-compute[70375]:       </nova:owner>
Jul 24 18:11:18 user nova-compute[70375]:       <nova:ports>
Jul 24 18:11:18 user nova-compute[70375]:         <nova:port uuid="1e56b02e-951c-4db9-ab39-0a0fc6fbf456">
Jul 24 18:11:18 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 18:11:18 user nova-compute[70375]:         </nova:port>
Jul 24 18:11:18 user nova-compute[70375]:       </nova:ports>
Jul 24 18:11:18 user nova-compute[70375]:     </nova:instance>
Jul 24 18:11:18 user nova-compute[70375]:   </metadata>
Jul 24 18:11:18 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:11:18 user nova-compute[70375]:     <system>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="serial">36962cd1-8583-4e95-99a2-f9348a02fa13</entry>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="uuid">36962cd1-8583-4e95-99a2-f9348a02fa13</entry>
Jul 24 18:11:18 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:11:18 user nova-compute[70375]:     </system>
Jul 24 18:11:18 user nova-compute[70375]:   </sysinfo>
Jul 24 18:11:18 user nova-compute[70375]:   <os>
Jul 24 18:11:18 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:11:18 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:11:18 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:11:18 user nova-compute[70375]:   </os>
Jul 24 18:11:18 user nova-compute[70375]:   <features>
Jul 24 18:11:18 user nova-compute[70375]:     <acpi/>
Jul 24 18:11:18 user nova-compute[70375]:     <apic/>
Jul 24 18:11:18 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:11:18 user nova-compute[70375]:   </features>
Jul 24 18:11:18 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:11:18 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:11:18 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:11:18 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:11:18 user nova-compute[70375]:   </clock>
Jul 24 18:11:18 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:11:18 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:11:18 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:11:18 user nova-compute[70375]:   </cpu>
Jul 24 18:11:18 user nova-compute[70375]:   <devices>
Jul 24 18:11:18 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:11:18 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:11:18 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:11:18 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:11:18 user nova-compute[70375]:       <serial>e228107b-8660-4388-bbf5-5908a34e12f3</serial>
Jul 24 18:11:18 user nova-compute[70375]:     </disk>
Jul 24 18:11:18 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:11:18 user nova-compute[70375]:       <mac address="fa:16:3e:09:40:8f"/>
Jul 24 18:11:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:11:18 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:11:18 user nova-compute[70375]:       <target dev="tap1e56b02e-95"/>
Jul 24 18:11:18 user nova-compute[70375]:     </interface>
Jul 24 18:11:18 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:11:18 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13/console.log" append="off"/>
Jul 24 18:11:18 user nova-compute[70375]:     </serial>
Jul 24 18:11:18 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:11:18 user nova-compute[70375]:     <video>
Jul 24 18:11:18 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:11:18 user nova-compute[70375]:     </video>
Jul 24 18:11:18 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:11:18 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:11:18 user nova-compute[70375]:     </rng>
Jul 24 18:11:18 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:11:18 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:11:18 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:11:18 user nova-compute[70375]:     </memballoon>
Jul 24 18:11:18 user nova-compute[70375]:   </devices>
Jul 24 18:11:18 user nova-compute[70375]: </domain>
Jul 24 18:11:18 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZbHjMQTEpcm2PnfEBNF2Te0+DVtjCpZ3qvnIb5pGOdeOvMhLwk9tUOIvFPtiFZcCzK0a0/kGk4VRG2qa25LLD315t/IH+Yv8Utcufm7ArLKVyQsy2RrFPatFdUoTBXA==',key_name='tempest-TestShelveInstance-1849990656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:11:09Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG os_vif [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e56b02e-95, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e56b02e-95, col_values=(('external_ids', {'iface-id': '1e56b02e-951c-4db9-ab39-0a0fc6fbf456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:40:8f', 'vm-uuid': '36962cd1-8583-4e95-99a2-f9348a02fa13'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:18 user nova-compute[70375]: INFO os_vif [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95')
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:11:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] No VIF found with MAC fa:16:3e:09:40:8f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:19 user nova-compute[70375]: WARNING nova.compute.manager [req-500b3080-ca22-428e-901b-37fce2c37a3c req-4c002d4c-8e78-45e1-b174-1967ec2e9395 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state building and task_state spawning.
Jul 24 18:11:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222281.654572, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Resumed (Lifecycle Event)
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance spawned successfully.
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222281.6585271, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Started (Lifecycle Event)
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Took 5.10 seconds to spawn the instance on the hypervisor.
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:21 user nova-compute[70375]: WARNING nova.compute.manager [req-e0931848-e8f1-4dfc-85b8-98c28c27e230 req-19ab4d06-460a-43f8-a298-a3dce02c62b8 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state building and task_state spawning.
Jul 24 18:11:21 user nova-compute[70375]: INFO nova.compute.manager [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Took 12.99 seconds to build instance.
Jul 24 18:11:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-59784e31-f375-488d-ba11-77e06a826564 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.086s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:34 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:11:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:39 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [{"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-d5a0ab25-5dc8-481b-9101-98318f72dab5" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:11:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:11:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:41 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:11:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:11:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=7870MB free_disk=23.921783447265625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 38b4d478-958e-4355-907d-884f43f9f799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9b6f5a7b-cce7-4693-8bbf-c03628574639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 36962cd1-8583-4e95-99a2-f9348a02fa13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:11:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:56 user nova-compute[70375]: INFO nova.compute.manager [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Terminating instance
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-unplugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] No waiting events found dispatching network-vif-unplugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-e25538ee-9dd1-4481-bbba-784bc5532afb req-eb64b585-20b7-4cd3-9bec-245a707b0389 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-unplugged-72f7de7c-535c-4a4d-bf67-7574132c87cf for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: INFO nova.compute.manager [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Terminating instance
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:11:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Instance destroyed successfully.
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid 9b6f5a7b-cce7-4693-8bbf-c03628574639 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-78919588',display_name='tempest-TestVolumeBootPattern-volume-backed-server-78919588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-78919588',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGA7i/hQUkXfKMjDXTU1MaqIWzx63Du4tq+wPpvMn0zr/EosiOb4fpmWcXNad0zy1GUMPKu07S+yFB3Q7klQzOk92dHXj60E+Q7yNv0UOwzPJ6NUATrzt4pcSGXeZCNIw==',key_name='tempest-keypair-1227481815',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-3kop3tpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73db0166ab6848748b6680624f570ead',uuid=9b6f5a7b-cce7-4693-8bbf-c03628574639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "address": "fa:16:3e:d6:16:a6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f7de7c-53", "ovs_interfaceid": "72f7de7c-535c-4a4d-bf67-7574132c87cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG os_vif [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72f7de7c-53, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:56 user nova-compute[70375]: INFO os_vif [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:16:a6,bridge_name='br-int',has_traffic_filtering=True,id=72f7de7c-535c-4a4d-bf67-7574132c87cf,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f7de7c-53')
Jul 24 18:11:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elGyADpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:11:56 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:11:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:11:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[518e5411-2681-439e-a5ae-8c8a955283cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:11:57 user nova-compute[70375]: No targets found.
Jul 24 18:11:57 user nova-compute[70375]: iSNS:
Jul 24 18:11:57 user nova-compute[70375]: No targets found.
Jul 24 18:11:57 user nova-compute[70375]: STATIC:
Jul 24 18:11:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:11:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3
Jul 24 18:11:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463
Jul 24 18:11:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:57 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:11:57 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:11:57 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:11:57 user nova-compute[70375]: FIRMWARE:
Jul 24 18:11:57 user nova-compute[70375]: No targets found.
Jul 24 18:11:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:11:57 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:11:57 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da9175-134e-4828-b90c-f8af9a51895f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36518c-dec6-4242-98ac-971fecef256e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:11:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6481f2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463'): ({'sdf'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdf {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ed42e-ad4c-4795-bf88-ed595c16a227]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d2416e-5e48-47b3-bdd3-66df30265a78]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdf {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e53ec0-623d-456b-ab99-bb08a12720ce]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4da8c2-ba95-496d-ba62-138992892065]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdf have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf84bead8-df9789be9d5b0a25', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f84bead8', '/dev/disk/by-id/scsi-26466393738396265') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d7810e-fe71-4f37-bd7c-f22085c91093]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[035373e2-5493-4437-bde7-38b43c0e7a3d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-775de370-d14d-4609-b71f-6a133d5ec445 req-5ddc1582-d7e1-4e37-aef8-b1077f0c3280 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-unplugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d47f3-f463-4624-8944-3755958c27ee]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260]
Jul 24 18:11:57 user nova-compute[70375]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463, portal: 172.16.0.220,3260] successful.
Jul 24 18:11:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2420ee-312f-4c7d-87b2-d33431eea463 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9d11a-4987-4a1a-80c5-f75fb5ac456d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (373ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Deleting instance files /opt/stack/data/nova/instances/9b6f5a7b-cce7-4693-8bbf-c03628574639_del
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Deletion of /opt/stack/data/nova/instances/9b6f5a7b-cce7-4693-8bbf-c03628574639_del complete
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.compute.manager [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Took 1.36 seconds to destroy the instance on the hypervisor.
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Instance destroyed successfully.
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lazy-loading 'resources' on Instance uuid 38b4d478-958e-4355-907d-884f43f9f799 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-882395697',display_name='tempest-ServerStableDeviceRescueTest-server-882395697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-882395697',id=33,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcHuHcfaaRB4/AQqnwNqOcQ1K1vm1m9o5CGpOYaaMJiDo+g+pkj8AyLaOZlGLvExJaEKDWMED4Uuzw5Rlil4qLOlJ/kHFW+SSE+GvyqLIIPvv2EqS+jEU0MMOyHbe5t+w==',key_name='tempest-keypair-138371338',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324c7b2c403942d28dfe43d9f6f30644',ramdisk_id='',reservation_id='r-atgmp2n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1383704498',owner_user_name='tempest-ServerStableDeviceRescueTest-1383704498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db18ae70ad59494e9f4c13b122f3ecc9',uuid=38b4d478-958e-4355-907d-884f43f9f799,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converting VIF {"id": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "address": "fa:16:3e:77:92:e7", "network": {"id": "2d9b108d-6197-448c-8a85-64d2291498bc", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-106954474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324c7b2c403942d28dfe43d9f6f30644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0e720f-2f", "ovs_interfaceid": "6f0e720f-2f21-413e-ba70-1f1d7581d414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG os_vif [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f0e720f-2f, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:11:57 user nova-compute[70375]: INFO os_vif [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:92:e7,bridge_name='br-int',has_traffic_filtering=True,id=6f0e720f-2f21-413e-ba70-1f1d7581d414,network=Network(2d9b108d-6197-448c-8a85-64d2291498bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0e720f-2f')
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Deleting instance files /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799_del
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Deletion of /opt/stack/data/nova/instances/38b4d478-958e-4355-907d-884f43f9f799_del complete
Jul 24 18:11:57 user nova-compute[70375]: INFO nova.compute.manager [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 18:11:57 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:11:57 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:58 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Took 0.83 seconds to deallocate network for instance.
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] Acquiring lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] No waiting events found dispatching network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:58 user nova-compute[70375]: WARNING nova.compute.manager [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received unexpected event network-vif-plugged-72f7de7c-535c-4a4d-bf67-7574132c87cf for instance with vm_state active and task_state deleting.
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-f8b0d36d-ebbc-4eb2-b11d-c81e3e374d9e req-c05c4fae-a9ab-4c6c-9465-e1e9ed77fbc9 service nova] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Received event network-vif-deleted-72f7de7c-535c-4a4d-bf67-7574132c87cf {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-84f52e0b-af2e-4800-9a32-551adedf8906 req-afcd73f1-961b-4a7e-927b-b369fb3bda19 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-deleted-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:58 user nova-compute[70375]: INFO nova.compute.manager [req-84f52e0b-af2e-4800-9a32-551adedf8906 req-afcd73f1-961b-4a7e-927b-b369fb3bda19 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Neutron deleted interface 6f0e720f-2f21-413e-ba70-1f1d7581d414; detaching it from the instance and deleting it from the info cache
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-84f52e0b-af2e-4800-9a32-551adedf8906 req-afcd73f1-961b-4a7e-927b-b369fb3bda19 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:11:58 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Took 1.24 seconds to deallocate network for instance.
Jul 24 18:11:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-84f52e0b-af2e-4800-9a32-551adedf8906 req-afcd73f1-961b-4a7e-927b-b369fb3bda19 service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Detach interface failed, port_id=6f0e720f-2f21-413e-ba70-1f1d7581d414, reason: Instance 38b4d478-958e-4355-907d-884f43f9f799 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:11:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:59 user nova-compute[70375]: INFO nova.compute.manager [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Took 0.76 seconds to detach 1 volumes for instance.
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.compute.manager [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Deleting volume: bc2420ee-312f-4c7d-87b2-d33431eea463 {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] Acquiring lock "38b4d478-958e-4355-907d-884f43f9f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] Lock "38b4d478-958e-4355-907d-884f43f9f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.compute.manager [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] No waiting events found dispatching network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:11:59 user nova-compute[70375]: WARNING nova.compute.manager [req-e8dfc961-a778-486c-ad45-de6da23cfd5c req-eba9fc5a-cd9d-4487-97e0-5c669a21f03d service nova] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Received unexpected event network-vif-plugged-6f0e720f-2f21-413e-ba70-1f1d7581d414 for instance with vm_state deleted and task_state None.
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.156s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:11:59 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Deleted allocations for instance 38b4d478-958e-4355-907d-884f43f9f799
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4f604b20-3acf-4b33-8e7b-6ed02d5e3cd2 tempest-ServerStableDeviceRescueTest-1383704498 tempest-ServerStableDeviceRescueTest-1383704498-project-member] Lock "38b4d478-958e-4355-907d-884f43f9f799" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.637s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:11:59 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance 9b6f5a7b-cce7-4693-8bbf-c03628574639
Jul 24 18:11:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-d2099ea5-367e-4eda-85c1-926688f1cd79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "9b6f5a7b-cce7-4693-8bbf-c03628574639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.650s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:12:11 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222316.8873365, 9b6f5a7b-cce7-4693-8bbf-c03628574639 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:12:11 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] VM Stopped (Lifecycle Event)
Jul 24 18:12:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-750d3ffc-50c9-4fda-8a2c-06669fcd1d02 None None] [instance: 9b6f5a7b-cce7-4693-8bbf-c03628574639] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222317.5960875, 38b4d478-958e-4355-907d-884f43f9f799 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:12:12 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 38b4d478-958e-4355-907d-884f43f9f799] VM Stopped (Lifecycle Event)
Jul 24 18:12:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-6fa5d840-7154-4fe8-8cba-16eac7e18fc1 None None] [instance: 38b4d478-958e-4355-907d-884f43f9f799] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:12:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:12:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:24 user nova-compute[70375]: INFO nova.compute.manager [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Terminating instance
Jul 24 18:12:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG nova.compute.manager [req-3a570bc1-e30f-4636-a150-56a2a089b7ef req-d45776b9-c975-46f3-ba83-5cc162c0cfd9 service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-unplugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Instance destroyed successfully.
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.objects.instance [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid edf496ee-bac6-4e86-9b16-c8f2f08f93e1 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-208816579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-208816579',id=36,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:08:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ck8ktxog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:10:38Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=edf496ee-bac6-4e86-9b16-c8f2f08f93e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "9b539894-c678-4ca9-9c36-e3d23129c922", "address": "fa:16:3e:e2:df:5a", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b539894-c6", "ovs_interfaceid": "9b539894-c678-4ca9-9c36-e3d23129c922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_vif [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b539894-c6, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:12:25 user nova-compute[70375]: INFO os_vif [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=9b539894-c678-4ca9-9c36-e3d23129c922,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b539894-c6')
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZRojqab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:12:25 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[559a335b-ccdf-472e-94f3-a5231a5e80dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:12:25 user nova-compute[70375]: No targets found.
Jul 24 18:12:25 user nova-compute[70375]: iSNS:
Jul 24 18:12:25 user nova-compute[70375]: No targets found.
Jul 24 18:12:25 user nova-compute[70375]: STATIC:
Jul 24 18:12:25 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e
Jul 24 18:12:25 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:12:25 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:12:25 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3
Jul 24 18:12:25 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:12:25 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:12:25 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:12:25 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:12:25 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:12:25 user nova-compute[70375]: FIRMWARE:
Jul 24 18:12:25 user nova-compute[70375]: No targets found.
Jul 24 18:12:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:12:25 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:12:25 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[50606643-3b8c-4183-9ac7-1ee9a740c137]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a9d0e-dcb6-4b9b-970f-50fbdf1f454e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:12:25 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:12:25 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:12:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:12:25 user nova-compute[70375]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e (non-flash)
Jul 24 18:12:25 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:12:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630328280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e'): ({'sde'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Removing single pathed devices sde {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c345dd-412f-4fd0-aaed-7ab0d21adf39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc8484-6fbb-4339-8e0e-59029922128b]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flushing IO for device /dev/sde {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e80406-d5b5-4ed3-96cb-b5e788a511c1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a61551-156a-4168-8386-765edc7420b4]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] SCSI volumes sde have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_91ef0fa6', '/dev/disk/by-id/scsi-23234626232373331', '/dev/disk/by-id/scsi-1SCST_BIO91ef0fa6-24bb2731ffc2619d') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[abce9802-99f8-4135-936c-fbdf5e7e7789]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c818b7-c57a-4775-aff6-fe1cde051a37]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c702b4d-cfd4-4fae-bfe4-e48f3b2d8243]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260]
Jul 24 18:12:25 user nova-compute[70375]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e, portal: 172.16.0.220,3260] successful.
Jul 24 18:12:25 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e50773b-eb3b-463b-a9f1-9f8eaf851c1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e4551d-22e4-4a69-b531-bd2e3c41acd7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== disconnect_volume: return (309ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:12:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Deleting instance files /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1_del
Jul 24 18:12:25 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Deletion of /opt/stack/data/nova/instances/edf496ee-bac6-4e86-9b16-c8f2f08f93e1_del complete
Jul 24 18:12:25 user nova-compute[70375]: INFO nova.compute.manager [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 24 18:12:25 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:12:25 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:12:26 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Took 0.54 seconds to deallocate network for instance.
Jul 24 18:12:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-908b55c8-b1f0-43cf-a4a7-8c8c24a3f2b7 req-94ed3f48-04b8-41ca-828e-6e1609a83acd service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-deleted-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] Acquiring lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] No waiting events found dispatching network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:12:26 user nova-compute[70375]: WARNING nova.compute.manager [req-ce0d23e6-6c16-46ed-9bd6-46b3706c964c req-c3a0d3f1-4565-4a98-a91f-f4462070508e service nova] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Received unexpected event network-vif-plugged-9b539894-c678-4ca9-9c36-e3d23129c922 for instance with vm_state active and task_state deleting.
Jul 24 18:12:26 user nova-compute[70375]: INFO nova.compute.manager [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Took 0.74 seconds to detach 1 volumes for instance.
Jul 24 18:12:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:27 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:12:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:12:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:27 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Deleted allocations for instance edf496ee-bac6-4e86-9b16-c8f2f08f93e1
Jul 24 18:12:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-332e737b-29ed-45bf-aa97-8951e52027ad tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "edf496ee-bac6-4e86-9b16-c8f2f08f93e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222345.225553, edf496ee-bac6-4e86-9b16-c8f2f08f93e1 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:12:40 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] VM Stopped (Lifecycle Event)
Jul 24 18:12:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b58c0347-71b2-40ba-bba4-f369f59542a4 None None] [instance: edf496ee-bac6-4e86-9b16-c8f2f08f93e1] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [{"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-0f4dbd9f-5580-4c29-86b9-cc35d7768715" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:12:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:12:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:12:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:12:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:12:48 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8315MB free_disk=24.030078887939453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 36962cd1-8583-4e95-99a2-f9348a02fa13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:12:48 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:12:49 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:12:49 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:12:49 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:12:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:12:57 user nova-compute[70375]: INFO nova.compute.claims [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Claim successful on node user
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:12:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:12:57 user nova-compute[70375]: INFO nova.virt.block_device [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Booting with volume 4e031d59-f636-40fa-8ebd-74ab04beb298 at /dev/vda
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.utils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.policy [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[927aab81-27ab-4300-b4dc-ac171a6b75c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd79b8-5f20-4ef5-aa45-dad5c081b2c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf750d-ac2b-4137-9cf6-355e0d2928ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d0ef5c-f4ac-42ac-8ddf-35bbde2c1b10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:12:57 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:12:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b63567b-6c26-4891-8a74-e0fc5578db05]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG os_brick.utils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updating existing volume attachment record: 54f339bc-784a-4157-8628-a3c0f907057c {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:12:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:12:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Successfully created port: e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:12:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Successfully updated port: e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-changed-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Refreshing instance network info cache due to event network-changed-e720b670-e932-4ecc-bb53-1c9e669c44c4. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] Acquiring lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updating instance_info_cache with network_info: [{"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Instance network_info: |[{"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] Acquired lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:00 user nova-compute[70375]: DEBUG nova.network.neutron [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Refreshing network info cache for port e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updated VIF entry in instance network info cache for port e720b670-e932-4ecc-bb53-1c9e669c44c4. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updating instance_info_cache with network_info: [{"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-394e2924-934d-4bca-9351-e306d323ebc2 req-522413cf-af5b-4974-80ab-42d7bc646caf service nova] Releasing lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing instance network info cache due to event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated VIF entry in instance network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG nova.network.neutron [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b505ad99-3d29-454d-807c-0ad71c6a9fe7 req-b4e91bf4-05f6-4bdc-854f-895005040374 service nova] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:02 user nova-compute[70375]: INFO nova.compute.manager [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Shelve offloading
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance destroyed successfully.
Jul 24 18:13:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:13:03 user nova-compute[70375]: INFO nova.compute.claims [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Claim successful on node user
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:03 user nova-compute[70375]: WARNING nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state active and task_state shelving.
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:03 user nova-compute[70375]: WARNING nova.compute.manager [req-624e0da0-d215-4008-b101-7c01ea923d51 req-f488dd19-261f-4982-b1ae-442fdbf4806d service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state active and task_state shelving.
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:13:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.policy [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e91fc2ae6a3e4ccaa35a33dc589bcb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c98e21a63a49a5817d6bf54d18dcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:13:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Creating image(s)
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:03 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance destroyed successfully.
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'resources' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing instance network info cache due to event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.network.neutron [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZbHjMQTEpcm2PnfEBNF2Te0+DVtjCpZ3qvnIb5pGOdeOvMhLwk9tUOIvFPtiFZcCzK0a0/kGk4VRG2qa25LLD315t/IH+Yv8Utcufm7ArLKVyQsy2RrFPatFdUoTBXA==',key_name='tempest-TestShelveInstance-1849990656',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:11:22Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG os_vif [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e56b02e-95, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:13:04 user nova-compute[70375]: INFO os_vif [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95')
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:13:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c9474-ed1d-4d92-93d9-af8d9f3807a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:13:04 user nova-compute[70375]: No targets found.
Jul 24 18:13:04 user nova-compute[70375]: iSNS:
Jul 24 18:13:04 user nova-compute[70375]: No targets found.
Jul 24 18:13:04 user nova-compute[70375]: STATIC:
Jul 24 18:13:04 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3
Jul 24 18:13:04 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:13:04 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:13:04 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:13:04 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:13:04 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:13:04 user nova-compute[70375]: FIRMWARE:
Jul 24 18:13:04 user nova-compute[70375]: No targets found.
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:13:04 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:13:04 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk 1073741824" returned: 0 in 0.052s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cbe1ec-f0db-4ef6-a7b8-842593e602cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa76a4-cef0-4329-9ad8-ee4551327cd7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe63035e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82852c96-5be7-4c77-94e3-49092b81662e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1267fea5-3313-4bfc-aeb8-adb69abfc07f]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[896e335f-efb1-4359-b32c-ffbbb0e12ac7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04cd7f2-d6e3-488e-b117-012b9cf4c145]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1b5b3-f692-40f2-b97a-d7f8ad026721]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f981d2-1ed6-4423-872a-f1bbbc4f465b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Cannot resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'migration_context' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]
Jul 24 18:13:04 user nova-compute[70375]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Ensure instance console log exists: /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[32661998-655e-4ccc-88a3-9f3f51d27dbd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== disconnect_volume: return (385ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:13:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deleting instance files /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13_del
Jul 24 18:13:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deletion of /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13_del complete
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:13:04 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Creating image(s)
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Ensure instance console log exists: /opt/stack/data/nova/instances/aeee2694-42b5-4d45-94c0-0e454bb4a60a/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Start _get_guest_xml network_info=[{"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '54f339bc-784a-4157-8628-a3c0f907057c', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aeee2694-42b5-4d45-94c0-0e454bb4a60a', 'attached_at': '', 'detached_at': '', 'volume_id': '4e031d59-f636-40fa-8ebd-74ab04beb298', 'serial': '4e031d59-f636-40fa-8ebd-74ab04beb298'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:13:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:13:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:13:04 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:13:04 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated VIF entry in instance network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.network.neutron [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": null, "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1e56b02e-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-30513007-da98-4cf8-9324-e9722410525e req-d1950d20-1687-45fe-98cb-72c1b263ae56 service nova] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac51c39-830c-42a0-add8-d1288e9aa882]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:13:04 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[da232322-10ee-42a4-9dbf-800d7318c3e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298] added
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b970544-9513-4d13-8b96-e79424ee5993]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a40ab1-2ea7-4098-bd4e-7d904fb86f3c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIyrBcWm {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIyrBcWm" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25fc42-fb7e-47b8-9ea3-277eba5c1f0b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIyrBcWm'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[809df050-5bcd-4af5-a6a3-ab3bdcb2c48a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[646df2d1-c876-47cb-83d3-65f035dac489]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4289e0-e5c4-42e5-8191-49a9fa3fd324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]
Jul 24 18:13:04 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[480dff02-e552-4f7d-a1c5-6f65e5ba2d73]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Successfully created port: 93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c542bda-d347-48c3-8c89-e644a709a4ef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:13:04 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[48241483-e85c-4b2b-b97c-ae3b14bf8b57]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:13:04 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:13:05 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Deleted allocations for instance 36962cd1-8583-4e95-99a2-f9348a02fa13
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'numa_topology' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Successfully updated port: 93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-changed-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Refreshing instance network info cache due to event network-changed-93758659-4637-43ef-b475-16dd6fc2ffb3. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f0307774-2e61-4877-b3c1-dbaf96b06b17 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.673s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23130326430653430', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130326430653430', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472868630',display_name='tempest-TestVolumeBootPattern-server-472868630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472868630',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-v0mqxf4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:12:58Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=aeee2694-42b5-4d45-94c0-0e454bb4a60a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid aeee2694-42b5-4d45-94c0-0e454bb4a60a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:13:05 user nova-compute[70375]:   <uuid>aeee2694-42b5-4d45-94c0-0e454bb4a60a</uuid>
Jul 24 18:13:05 user nova-compute[70375]:   <name>instance-00000029</name>
Jul 24 18:13:05 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:13:05 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:13:05 user nova-compute[70375]:   <metadata>
Jul 24 18:13:05 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:13:05 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:13:05 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-server-472868630</nova:name>
Jul 24 18:13:05 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:13:04</nova:creationTime>
Jul 24 18:13:05 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:13:05 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:13:05 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:13:05 user nova-compute[70375]:       <nova:owner>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:13:05 user nova-compute[70375]:       </nova:owner>
Jul 24 18:13:05 user nova-compute[70375]:       <nova:ports>
Jul 24 18:13:05 user nova-compute[70375]:         <nova:port uuid="e720b670-e932-4ecc-bb53-1c9e669c44c4">
Jul 24 18:13:05 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 18:13:05 user nova-compute[70375]:         </nova:port>
Jul 24 18:13:05 user nova-compute[70375]:       </nova:ports>
Jul 24 18:13:05 user nova-compute[70375]:     </nova:instance>
Jul 24 18:13:05 user nova-compute[70375]:   </metadata>
Jul 24 18:13:05 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:13:05 user nova-compute[70375]:     <system>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="serial">aeee2694-42b5-4d45-94c0-0e454bb4a60a</entry>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="uuid">aeee2694-42b5-4d45-94c0-0e454bb4a60a</entry>
Jul 24 18:13:05 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:13:05 user nova-compute[70375]:     </system>
Jul 24 18:13:05 user nova-compute[70375]:   </sysinfo>
Jul 24 18:13:05 user nova-compute[70375]:   <os>
Jul 24 18:13:05 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:13:05 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:13:05 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:13:05 user nova-compute[70375]:   </os>
Jul 24 18:13:05 user nova-compute[70375]:   <features>
Jul 24 18:13:05 user nova-compute[70375]:     <acpi/>
Jul 24 18:13:05 user nova-compute[70375]:     <apic/>
Jul 24 18:13:05 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:13:05 user nova-compute[70375]:   </features>
Jul 24 18:13:05 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:13:05 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:13:05 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:13:05 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:13:05 user nova-compute[70375]:   </clock>
Jul 24 18:13:05 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:13:05 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:13:05 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:13:05 user nova-compute[70375]:   </cpu>
Jul 24 18:13:05 user nova-compute[70375]:   <devices>
Jul 24 18:13:05 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:13:05 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:13:05 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:13:05 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:13:05 user nova-compute[70375]:       <serial>4e031d59-f636-40fa-8ebd-74ab04beb298</serial>
Jul 24 18:13:05 user nova-compute[70375]:     </disk>
Jul 24 18:13:05 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:13:05 user nova-compute[70375]:       <mac address="fa:16:3e:17:c7:f7"/>
Jul 24 18:13:05 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:13:05 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:13:05 user nova-compute[70375]:       <target dev="tape720b670-e9"/>
Jul 24 18:13:05 user nova-compute[70375]:     </interface>
Jul 24 18:13:05 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:13:05 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/aeee2694-42b5-4d45-94c0-0e454bb4a60a/console.log" append="off"/>
Jul 24 18:13:05 user nova-compute[70375]:     </serial>
Jul 24 18:13:05 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:13:05 user nova-compute[70375]:     <video>
Jul 24 18:13:05 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:13:05 user nova-compute[70375]:     </video>
Jul 24 18:13:05 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:13:05 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:13:05 user nova-compute[70375]:     </rng>
Jul 24 18:13:05 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:13:05 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:13:05 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:13:05 user nova-compute[70375]:     </memballoon>
Jul 24 18:13:05 user nova-compute[70375]:   </devices>
Jul 24 18:13:05 user nova-compute[70375]: </domain>
Jul 24 18:13:05 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472868630',display_name='tempest-TestVolumeBootPattern-server-472868630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472868630',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-v0mqxf4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:12:58Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=aeee2694-42b5-4d45-94c0-0e454bb4a60a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG os_vif [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape720b670-e9, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape720b670-e9, col_values=(('external_ids', {'iface-id': 'e720b670-e932-4ecc-bb53-1c9e669c44c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:c7:f7', 'vm-uuid': 'aeee2694-42b5-4d45-94c0-0e454bb4a60a'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:05 user nova-compute[70375]: INFO os_vif [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9')
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance network_info: |[{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:05 user nova-compute[70375]: DEBUG nova.network.neutron [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Refreshing network info cache for port 93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start _get_guest_xml network_info=[{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:17:c7:f7, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:13:06 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:06 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'pci_devices' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:13:06 user nova-compute[70375]:   <uuid>c10a72e2-3387-47f7-938e-57f69b58c887</uuid>
Jul 24 18:13:06 user nova-compute[70375]:   <name>instance-0000002a</name>
Jul 24 18:13:06 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:13:06 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:13:06 user nova-compute[70375]:   <metadata>
Jul 24 18:13:06 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:13:06 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeTestJSON-server-1173996728</nova:name>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:13:06</nova:creationTime>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:13:06 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:13:06 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:owner>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:user uuid="e91fc2ae6a3e4ccaa35a33dc589bcb63">tempest-AttachVolumeTestJSON-67425413-project-member</nova:user>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:project uuid="49c98e21a63a49a5817d6bf54d18dcd1">tempest-AttachVolumeTestJSON-67425413</nova:project>
Jul 24 18:13:06 user nova-compute[70375]:       </nova:owner>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:13:06 user nova-compute[70375]:       <nova:ports>
Jul 24 18:13:06 user nova-compute[70375]:         <nova:port uuid="93758659-4637-43ef-b475-16dd6fc2ffb3">
Jul 24 18:13:06 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 18:13:06 user nova-compute[70375]:         </nova:port>
Jul 24 18:13:06 user nova-compute[70375]:       </nova:ports>
Jul 24 18:13:06 user nova-compute[70375]:     </nova:instance>
Jul 24 18:13:06 user nova-compute[70375]:   </metadata>
Jul 24 18:13:06 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:13:06 user nova-compute[70375]:     <system>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="serial">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="uuid">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:13:06 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:13:06 user nova-compute[70375]:     </system>
Jul 24 18:13:06 user nova-compute[70375]:   </sysinfo>
Jul 24 18:13:06 user nova-compute[70375]:   <os>
Jul 24 18:13:06 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:13:06 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:13:06 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:13:06 user nova-compute[70375]:   </os>
Jul 24 18:13:06 user nova-compute[70375]:   <features>
Jul 24 18:13:06 user nova-compute[70375]:     <acpi/>
Jul 24 18:13:06 user nova-compute[70375]:     <apic/>
Jul 24 18:13:06 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:13:06 user nova-compute[70375]:   </features>
Jul 24 18:13:06 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:13:06 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:13:06 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:13:06 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:13:06 user nova-compute[70375]:   </clock>
Jul 24 18:13:06 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:13:06 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:13:06 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:13:06 user nova-compute[70375]:   </cpu>
Jul 24 18:13:06 user nova-compute[70375]:   <devices>
Jul 24 18:13:06 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:13:06 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:13:06 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk"/>
Jul 24 18:13:06 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:13:06 user nova-compute[70375]:     </disk>
Jul 24 18:13:06 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:13:06 user nova-compute[70375]:       <mac address="fa:16:3e:cc:6a:95"/>
Jul 24 18:13:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:13:06 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:13:06 user nova-compute[70375]:       <target dev="tap93758659-46"/>
Jul 24 18:13:06 user nova-compute[70375]:     </interface>
Jul 24 18:13:06 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:13:06 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/console.log" append="off"/>
Jul 24 18:13:06 user nova-compute[70375]:     </serial>
Jul 24 18:13:06 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:13:06 user nova-compute[70375]:     <video>
Jul 24 18:13:06 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:13:06 user nova-compute[70375]:     </video>
Jul 24 18:13:06 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:13:06 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:13:06 user nova-compute[70375]:     </rng>
Jul 24 18:13:06 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:13:06 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:13:06 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:13:06 user nova-compute[70375]:     </memballoon>
Jul 24 18:13:06 user nova-compute[70375]:   </devices>
Jul 24 18:13:06 user nova-compute[70375]: </domain>
Jul 24 18:13:06 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG os_vif [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93758659-46, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93758659-46, col_values=(('external_ids', {'iface-id': '93758659-4637-43ef-b475-16dd6fc2ffb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6a:95', 'vm-uuid': 'c10a72e2-3387-47f7-938e-57f69b58c887'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:06 user nova-compute[70375]: INFO os_vif [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No VIF found with MAC fa:16:3e:cc:6a:95, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updated VIF entry in instance network info cache for port 93758659-4637-43ef-b475-16dd6fc2ffb3. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG nova.network.neutron [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dfc2b9dd-03ec-4b5a-8cd2-68812cede431 req-1b1c98ca-127d-4e45-92b4-5a09e0249244 service nova] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] No waiting events found dispatching network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:08 user nova-compute[70375]: WARNING nova.compute.manager [req-206c444e-b046-477b-9c08-e4db57c61122 req-c64fea27-b6f2-4fa2-a43e-d9b33bb79373 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received unexpected event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 for instance with vm_state building and task_state spawning.
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] No waiting events found dispatching network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:10 user nova-compute[70375]: WARNING nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received unexpected event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 for instance with vm_state building and task_state spawning.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:10 user nova-compute[70375]: WARNING nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state building and task_state spawning.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:10 user nova-compute[70375]: WARNING nova.compute.manager [req-86d1f160-fc87-4aaf-ae96-ea4dadce399f req-ce24fd08-9f3c-465b-ae0e-c1dbb46e714e service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state building and task_state spawning.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222390.7931786, aeee2694-42b5-4d45-94c0-0e454bb4a60a => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] VM Resumed (Lifecycle Event)
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Instance spawned successfully.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222390.7945828, aeee2694-42b5-4d45-94c0-0e454bb4a60a => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] VM Started (Lifecycle Event)
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222390.8763397, c10a72e2-3387-47f7-938e-57f69b58c887 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Resumed (Lifecycle Event)
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance spawned successfully.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Took 6.42 seconds to spawn the instance on the hypervisor.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:13:10 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222390.878902, c10a72e2-3387-47f7-938e-57f69b58c887 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:10 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Started (Lifecycle Event)
Jul 24 18:13:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:11 user nova-compute[70375]: INFO nova.compute.manager [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Took 13.98 seconds to build instance.
Jul 24 18:13:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:13:11 user nova-compute[70375]: INFO nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Took 7.30 seconds to spawn the instance on the hypervisor.
Jul 24 18:13:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b08ebd5e-6e20-4eee-8ce3-5bff28aa2f79 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.106s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:13:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:11 user nova-compute[70375]: INFO nova.compute.manager [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Took 7.94 seconds to build instance.
Jul 24 18:13:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-2ef2aa38-7c87-480c-9c92-d43c6069b97e tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.031s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:15 user nova-compute[70375]: INFO nova.compute.manager [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Terminating instance
Jul 24 18:13:15 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-unplugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] No waiting events found dispatching network-vif-unplugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG nova.compute.manager [req-9e863ac5-b1b0-4882-9291-cd6fce4c93f8 req-fd1552c2-cc48-4f94-a858-f50def0ab9cb service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-unplugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Instance destroyed successfully.
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid 184e5f1c-e463-4bd6-a9b0-f44a35748220 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132135910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132135910',id=31,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:03:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-8vbjfis5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:05:50Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=184e5f1c-e463-4bd6-a9b0-f44a35748220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "address": "fa:16:3e:a3:b1:c5", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped672e87-0c", "ovs_interfaceid": "ed672e87-0cc7-44a2-8fe8-d79cb344d805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG os_vif [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped672e87-0c, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:13:16 user nova-compute[70375]: INFO os_vif [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b1:c5,bridge_name='br-int',has_traffic_filtering=True,id=ed672e87-0cc7-44a2-8fe8-d79cb344d805,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped672e87-0c')
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Deleting instance files /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220_del
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Deletion of /opt/stack/data/nova/instances/184e5f1c-e463-4bd6-a9b0-f44a35748220_del complete
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.compute.manager [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 18:13:16 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Took 0.60 seconds to deallocate network for instance.
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0daa5af-bf15-41aa-8c1b-947b17cbae94 req-7131f036-c29e-431d-a900-2c7bf467d959 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-deleted-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:16 user nova-compute[70375]: INFO nova.compute.manager [req-a0daa5af-bf15-41aa-8c1b-947b17cbae94 req-7131f036-c29e-431d-a900-2c7bf467d959 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Neutron deleted interface ed672e87-0cc7-44a2-8fe8-d79cb344d805; detaching it from the instance and deleting it from the info cache
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.network.neutron [req-a0daa5af-bf15-41aa-8c1b-947b17cbae94 req-7131f036-c29e-431d-a900-2c7bf467d959 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0daa5af-bf15-41aa-8c1b-947b17cbae94 req-7131f036-c29e-431d-a900-2c7bf467d959 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Detach interface failed, port_id=ed672e87-0cc7-44a2-8fe8-d79cb344d805, reason: Instance 184e5f1c-e463-4bd6-a9b0-f44a35748220 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:16 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:17 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Deleted allocations for instance 184e5f1c-e463-4bd6-a9b0-f44a35748220
Jul 24 18:13:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c225066e-377d-4faf-81bd-0a3ed0b406ee tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] Acquiring lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] Lock "184e5f1c-e463-4bd6-a9b0-f44a35748220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.compute.manager [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] No waiting events found dispatching network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:13:17 user nova-compute[70375]: WARNING nova.compute.manager [req-0824bff4-023b-4b37-8489-9828f2d60909 req-3e98e39e-5071-4389-9662-e63d073f4c03 service nova] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Received unexpected event network-vif-plugged-ed672e87-0cc7-44a2-8fe8-d79cb344d805 for instance with vm_state deleted and task_state None.
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222382.7980886, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:17 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Stopped (Lifecycle Event)
Jul 24 18:13:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f3462610-a35e-43d7-9111-e35e95c699bb None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:31 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222396.0622196, 184e5f1c-e463-4bd6-a9b0-f44a35748220 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:13:31 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] VM Stopped (Lifecycle Event)
Jul 24 18:13:31 user nova-compute[70375]: DEBUG nova.compute.manager [None req-e6a3eaec-7c2b-4e9a-98b8-85d68eb515ac None None] [instance: 184e5f1c-e463-4bd6-a9b0-f44a35748220] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:13:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:35 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updating instance_info_cache with network_info: [{"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:13:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:13:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:13:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:13:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:13:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:13:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:13:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=24.115047454833984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance aeee2694-42b5-4d45-94c0-0e454bb4a60a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:13:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:13:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:13:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:13:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:13:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:13:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:13:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:13:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:05 user nova-compute[70375]: INFO nova.compute.manager [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Terminating instance
Jul 24 18:14:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.compute.manager [req-1db609a5-9b51-4177-ac26-32d97954b557 req-4cb652b1-3f5a-4542-a806-75b320252e7a service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-unplugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Instance destroyed successfully.
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid 0f4dbd9f-5580-4c29-86b9-cc35d7768715 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1948242503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1948242503',id=25,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:00:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-ordclwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:02:03Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=0f4dbd9f-5580-4c29-86b9-cc35d7768715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "address": "fa:16:3e:0c:d5:e6", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6875b8c9-3b", "ovs_interfaceid": "6875b8c9-3b0f-4193-9a70-e68e0f5a8028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_vif [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6875b8c9-3b, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:06 user nova-compute[70375]: INFO os_vif [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d5:e6,bridge_name='br-int',has_traffic_filtering=True,id=6875b8c9-3b0f-4193-9a70-e68e0f5a8028,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6875b8c9-3b')
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvrRIYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:14:06 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e6efc-896b-4685-8952-a22db218b0f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:14:06 user nova-compute[70375]: No targets found.
Jul 24 18:14:06 user nova-compute[70375]: iSNS:
Jul 24 18:14:06 user nova-compute[70375]: No targets found.
Jul 24 18:14:06 user nova-compute[70375]: STATIC:
Jul 24 18:14:06 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:14:06 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:14:06 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:14:06 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77
Jul 24 18:14:06 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:14:06 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:14:06 user nova-compute[70375]: FIRMWARE:
Jul 24 18:14:06 user nova-compute[70375]: No targets found.
Jul 24 18:14:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:14:06 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:14:06 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e6e468-d613-45af-aeff-06ec2dfb7fc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4480f942-032c-4f03-b650-11c27e627810]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:14:06 user nova-compute[70375]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:14:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 (non-flash)
Jul 24 18:14:06 user nova-compute[70375]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:14:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6305b1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd480059-d34d-4ca7-af9b-e7bd301c599d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bae210-cecf-42ae-83d8-13752994f9d8]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a371a5-3d41-4d94-8a05-6135a60a4d7f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f65265-3688-4080-b33c-2f156063632f]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e80a80-13ed-49ac-a395-00a9b8f62ae5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73e308-bfc7-45f5-9910-e9ac0dba9457]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260]
Jul 24 18:14:06 user nova-compute[70375]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77, portal: 172.16.0.220,3260] successful.
Jul 24 18:14:06 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a853cda1-83d4-42f3-bc65-a869f4a12d77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6e64cb-73e4-4344-86fe-8db2e87ca869]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] <== disconnect_volume: return (292ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:14:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:14:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Deleting instance files /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715_del
Jul 24 18:14:06 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Deletion of /opt/stack/data/nova/instances/0f4dbd9f-5580-4c29-86b9-cc35d7768715_del complete
Jul 24 18:14:07 user nova-compute[70375]: INFO nova.compute.manager [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 24 18:14:07 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:14:07 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:14:07 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:14:07 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:07 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Took 0.50 seconds to deallocate network for instance.
Jul 24 18:14:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-5b34c112-bc85-4994-a2da-6d836c752c3b req-9b9903a5-0308-402e-a6df-948b796eb6d8 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-deleted-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] Acquiring lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] No waiting events found dispatching network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:08 user nova-compute[70375]: WARNING nova.compute.manager [req-6f3d31c3-965e-4480-acfc-5a5bb8b36a89 req-702ac892-4ca6-4fad-a0d8-03d131e50686 service nova] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Received unexpected event network-vif-plugged-6875b8c9-3b0f-4193-9a70-e68e0f5a8028 for instance with vm_state active and task_state deleting.
Jul 24 18:14:08 user nova-compute[70375]: INFO nova.compute.manager [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Took 0.75 seconds to detach 1 volumes for instance.
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:08 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Deleted allocations for instance 0f4dbd9f-5580-4c29-86b9-cc35d7768715
Jul 24 18:14:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70fe347c-61f0-49e6-9347-a635e9b34081 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "0f4dbd9f-5580-4c29-86b9-cc35d7768715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222446.5624082, 0f4dbd9f-5580-4c29-86b9-cc35d7768715 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:14:21 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] VM Stopped (Lifecycle Event)
Jul 24 18:14:21 user nova-compute[70375]: DEBUG nova.compute.manager [None req-18b38381-1f38-4270-a3d8-6cac20d98b43 None None] [instance: 0f4dbd9f-5580-4c29-86b9-cc35d7768715] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:14:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:30 user nova-compute[70375]: INFO nova.compute.manager [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Terminating instance
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-unplugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] No waiting events found dispatching network-vif-unplugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-62fec965-125c-4b75-a292-ace274261246 req-929a81d6-e8a1-4dae-b591-e0eef825e2e8 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-unplugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:14:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Instance destroyed successfully.
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.objects.instance [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lazy-loading 'resources' on Instance uuid b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1513166301',display_name='tempest-ServersNegativeTestJSON-server-1513166301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1513166301',id=35,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0efa461cc94bd594ad5e72f98d11f9',ramdisk_id='',reservation_id='r-z4hj71s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-750541146',owner_user_name='tempest-ServersNegativeTestJSON-750541146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:05:47Z,user_data=None,user_id='54ed6f06c3524fae8e6dcd4514c97fad',uuid=b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converting VIF {"id": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "address": "fa:16:3e:69:d6:04", "network": {"id": "c48bb74e-ea5f-4827-8272-dc02dcebb922", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970279641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0efa461cc94bd594ad5e72f98d11f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbe2cdc-8d", "ovs_interfaceid": "cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG os_vif [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbe2cdc-8d, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:30 user nova-compute[70375]: INFO os_vif [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:04,bridge_name='br-int',has_traffic_filtering=True,id=cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da,network=Network(c48bb74e-ea5f-4827-8272-dc02dcebb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbe2cdc-8d')
Jul 24 18:14:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Deleting instance files /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3_del
Jul 24 18:14:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Deletion of /opt/stack/data/nova/instances/b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3_del complete
Jul 24 18:14:30 user nova-compute[70375]: INFO nova.compute.manager [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 18:14:30 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:14:30 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:14:31 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:31 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Took 0.57 seconds to deallocate network for instance.
Jul 24 18:14:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:31 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:14:31 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:14:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:31 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Deleted allocations for instance b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3
Jul 24 18:14:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-cdf73fba-3e97-4e7c-9723-e27169d07959 tempest-ServersNegativeTestJSON-750541146 tempest-ServersNegativeTestJSON-750541146-project-member] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] Acquiring lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] Lock "b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] No waiting events found dispatching network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:32 user nova-compute[70375]: WARNING nova.compute.manager [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received unexpected event network-vif-plugged-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da for instance with vm_state deleted and task_state None.
Jul 24 18:14:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-b52c9778-c2d4-4dc8-894e-dffc77254727 req-a12f5b57-b796-4c99-af92-23cb8e2f5bb6 service nova] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Received event network-vif-deleted-cfbe2cdc-8d28-4eb8-b6b1-40bd0439f0da {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:33 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid aeee2694-42b5-4d45-94c0-0e454bb4a60a {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:14:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Skipping network cache update for instance because it has been migrated to another host. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9866}}
Jul 24 18:14:43 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:14:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222470.7932544, b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:14:45 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] VM Stopped (Lifecycle Event)
Jul 24 18:14:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1029b2b2-73c5-4fec-882d-1c71d0de891b None None] [instance: b7e1d7d6-82a6-48fa-b36a-5142c29a3ae3] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:14:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:14:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-changed-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Refreshing instance network info cache due to event network-changed-e720b670-e932-4ecc-bb53-1c9e669c44c4. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:14:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] Acquiring lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:14:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] Acquired lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:14:48 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Refreshing network info cache for port e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:14:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updated VIF entry in instance network info cache for port e720b670-e932-4ecc-bb53-1c9e669c44c4. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:14:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updating instance_info_cache with network_info: [{"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4d06d34d-2f7c-4888-b538-5c83d950d309 req-779025a7-e66c-4f3d-95fa-7f5ea235b291 service nova] Releasing lock "refresh_cache-aeee2694-42b5-4d45-94c0-0e454bb4a60a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:50 user nova-compute[70375]: INFO nova.compute.manager [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Terminating instance
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-unplugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] No waiting events found dispatching network-vif-unplugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ee0e0b17-7b19-4186-adc8-26eac8b30315 req-7ada2810-7a31-432c-91c7-a639e01e8499 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-unplugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:14:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Instance destroyed successfully.
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid aeee2694-42b5-4d45-94c0-0e454bb4a60a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:14:51 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:14:51 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=24.141677856445312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-472868630',display_name='tempest-TestVolumeBootPattern-server-472868630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-472868630',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-v0mqxf4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:13:11Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=aeee2694-42b5-4d45-94c0-0e454bb4a60a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "address": "fa:16:3e:17:c7:f7", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape720b670-e9", "ovs_interfaceid": "e720b670-e932-4ecc-bb53-1c9e669c44c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_vif [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape720b670-e9, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:51 user nova-compute[70375]: INFO os_vif [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:c7:f7,bridge_name='br-int',has_traffic_filtering=True,id=e720b670-e932-4ecc-bb53-1c9e669c44c4,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape720b670-e9')
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:14:51 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca757f16-fd12-4276-a1a5-fdb759f2808a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:14:51 user nova-compute[70375]: No targets found.
Jul 24 18:14:51 user nova-compute[70375]: iSNS:
Jul 24 18:14:51 user nova-compute[70375]: No targets found.
Jul 24 18:14:51 user nova-compute[70375]: STATIC:
Jul 24 18:14:51 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:14:51 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:14:51 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:14:51 user nova-compute[70375]: FIRMWARE:
Jul 24 18:14:51 user nova-compute[70375]: No targets found.
Jul 24 18:14:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:14:51 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:14:51 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[448bae26-792e-4156-9a4f-1334c3734794]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance aeee2694-42b5-4d45-94c0-0e454bb4a60a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd7a9d-10d3-4254-99ad-248b0a40ad91]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:14:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:14:51 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe63033bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb1ee4-b34d-45ac-9e0b-e46b1f3691e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc16993-bf09-4905-b933-90547ef924e9]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[407cf063-4400-45be-a77b-429b7839e94b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e7217-67d9-4f7f-9aaf-a972a6837695]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a713cc-e638-4eab-9a0c-06d90a88af98]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad865d57-6bfa-45f5-846b-3b23d4673187]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]
Jul 24 18:14:52 user nova-compute[70375]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.
Jul 24 18:14:52 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2cb78f-dacc-4d76-ac86-4e4214a0b819]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (303ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:14:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Deleting instance files /opt/stack/data/nova/instances/aeee2694-42b5-4d45-94c0-0e454bb4a60a_del
Jul 24 18:14:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Deletion of /opt/stack/data/nova/instances/aeee2694-42b5-4d45-94c0-0e454bb4a60a_del complete
Jul 24 18:14:52 user nova-compute[70375]: INFO nova.compute.manager [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Took 1.56 seconds to destroy the instance on the hypervisor.
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] Acquiring lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] No waiting events found dispatching network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:52 user nova-compute[70375]: WARNING nova.compute.manager [req-b2dc6fbc-aa2a-42e1-927d-1d4bf341611b req-3db679e1-6e0b-4e3a-9bbf-9f3cc8fe4a54 service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received unexpected event network-vif-plugged-e720b670-e932-4ecc-bb53-1c9e669c44c4 for instance with vm_state active and task_state deleting.
Jul 24 18:14:53 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:53 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Took 1.24 seconds to deallocate network for instance.
Jul 24 18:14:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-b3f5bc5a-16f3-43cb-9a6b-26d8e9a119f0 req-5ee5e9bf-f8d5-4a74-b6b7-71631dcfd69a service nova] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Received event network-vif-deleted-e720b670-e932-4ecc-bb53-1c9e669c44c4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:54 user nova-compute[70375]: INFO nova.compute.manager [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Took 0.76 seconds to detach 1 volumes for instance.
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:54 user nova-compute[70375]: INFO nova.compute.manager [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Unshelving
Jul 24 18:14:54 user nova-compute[70375]: INFO nova.virt.block_device [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Booting with volume e228107b-8660-4388-bbf5-5908a34e12f3 at /dev/vda
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.utils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-changed-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.compute.manager [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Refreshing instance network info cache due to event network-changed-93758659-4637-43ef-b475-16dd6fc2ffb3. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Refreshing network info cache for port 93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a259b9d-8fbd-4195-81ae-e9c0897a6380]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b82a2-cb55-43f4-b89e-41be4fa4ccec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:54 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance aeee2694-42b5-4d45-94c0-0e454bb4a60a
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2df37c-ae37-4872-b62b-327f4afc3b59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54611fba-243d-4b2a-8c94-24b09e4f7204]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:14:54 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e32a0d-ebc1-4157-a9d2-aabf0f5a9ca7]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG os_brick.utils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating existing volume attachment record: fd6038ef-8f50-4494-9ab3-8d4b1b22ed62 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-ffbe1cdc-01c6-45fc-8ab4-f4b027c2d5d7 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "aeee2694-42b5-4d45-94c0-0e454bb4a60a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.974s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updated VIF entry in instance network info cache for port 93758659-4637-43ef-b475-16dd6fc2ffb3. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG nova.network.neutron [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6339e740-10d9-4998-ab9a-c5ce0fdc8951 req-0ddf080e-603e-48fb-ba00-df9e1f0732b4 service nova] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:56 user nova-compute[70375]: INFO nova.compute.manager [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Terminating instance
Jul 24 18:14:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-unplugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] No waiting events found dispatching network-vif-unplugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:56 user nova-compute[70375]: DEBUG nova.compute.manager [req-fe8468b1-1597-4ded-8953-fd0716bdea66 req-93f98ff5-d66b-46a4-a8d6-caa29ac443d2 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-unplugged-a52a9b03-6d63-4b30-9868-e91da7546225 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Instance destroyed successfully.
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lazy-loading 'resources' on Instance uuid d5a0ab25-5dc8-481b-9101-98318f72dab5 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-300805815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-300805815',id=21,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5a644d007b4ecdbde7ec4788464675',ramdisk_id='',reservation_id='r-pg0bn8ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-616724674',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:57:14Z,user_data=None,user_id='1c1aa740b7404c2e8703488bcd87404d',uuid=d5a0ab25-5dc8-481b-9101-98318f72dab5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converting VIF {"id": "a52a9b03-6d63-4b30-9868-e91da7546225", "address": "fa:16:3e:d0:2d:a7", "network": {"id": "0e6bb1aa-138b-4ce4-8842-36a046b84570", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-289326369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5a644d007b4ecdbde7ec4788464675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa52a9b03-6d", "ovs_interfaceid": "a52a9b03-6d63-4b30-9868-e91da7546225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG os_vif [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa52a9b03-6d, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:14:57 user nova-compute[70375]: INFO os_vif [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a52a9b03-6d63-4b30-9868-e91da7546225,network=Network(0e6bb1aa-138b-4ce4-8842-36a046b84570),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa52a9b03-6d')
Jul 24 18:14:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Deleting instance files /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5_del
Jul 24 18:14:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Deletion of /opt/stack/data/nova/instances/d5a0ab25-5dc8-481b-9101-98318f72dab5_del complete
Jul 24 18:14:57 user nova-compute[70375]: INFO nova.compute.manager [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 18:14:57 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:14:57 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-c5022738-3fca-4016-9b97-0e1ca5b84342 req-ba91d823-07f6-4c67-b800-c18dd57d8579 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-deleted-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:58 user nova-compute[70375]: INFO nova.compute.manager [req-c5022738-3fca-4016-9b97-0e1ca5b84342 req-ba91d823-07f6-4c67-b800-c18dd57d8579 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Neutron deleted interface a52a9b03-6d63-4b30-9868-e91da7546225; detaching it from the instance and deleting it from the info cache
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-c5022738-3fca-4016-9b97-0e1ca5b84342 req-ba91d823-07f6-4c67-b800-c18dd57d8579 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:14:58 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Took 0.60 seconds to deallocate network for instance.
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-c5022738-3fca-4016-9b97-0e1ca5b84342 req-ba91d823-07f6-4c67-b800-c18dd57d8579 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Detach interface failed, port_id=a52a9b03-6d63-4b30-9868-e91da7546225, reason: Instance d5a0ab25-5dc8-481b-9101-98318f72dab5 could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:58 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Deleted allocations for instance d5a0ab25-5dc8-481b-9101-98318f72dab5
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b1115756-211a-41e8-afc2-559b12950cb4 tempest-ServerBootFromVolumeStableRescueTest-616724674 tempest-ServerBootFromVolumeStableRescueTest-616724674-project-member] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] Acquiring lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] Lock "d5a0ab25-5dc8-481b-9101-98318f72dab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] No waiting events found dispatching network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:14:58 user nova-compute[70375]: WARNING nova.compute.manager [req-6e3f9e3e-ce93-4cf6-8efb-a418e9331426 req-150e1ccb-bfc5-47bb-b09b-3cc7827c4bf8 service nova] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Received unexpected event network-vif-plugged-a52a9b03-6d63-4b30-9868-e91da7546225 for instance with vm_state deleted and task_state None.
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:14:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:14:58 user nova-compute[70375]: INFO nova.compute.manager [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Attaching volume 2a6d7f61-7355-4468-b9ef-2626b3f2ed8f to /dev/vdb
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.utils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[64804931-40f2-4c0e-87a3-3ff038b7b47e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d15c7-f314-460b-a564-b728c35d6aee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a426f8-fbb2-43f2-98f3-31e7cc5e48fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[528cf9f9-c3fe-4edb-8749-d629ec371316]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:14:59 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:14:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a09cb-d484-40af-865b-ebe846379a54]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG os_brick.utils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:14:59 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating existing volume attachment record: 4e9c92cc-28e4-4615-b4fb-ba3e6bd60805 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'pci_requests' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG nova.objects.instance [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'numa_topology' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:15:00 user nova-compute[70375]: INFO nova.compute.claims [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Claim successful on node user
Jul 24 18:15:00 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:15:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:01 user nova-compute[70375]: INFO nova.network.neutron [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG nova.network.neutron [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG nova.compute.manager [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing instance network info cache due to event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:15:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:15:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Creating image(s)
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Ensure instance console log exists: /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start _get_guest_xml network_info=[{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd6038ef-8f50-4494-9ab3-8d4b1b22ed62', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36962cd1-8583-4e95-99a2-f9348a02fa13', 'attached_at': '', 'detached_at': '', 'volume_id': 'e228107b-8660-4388-bbf5-5908a34e12f3', 'serial': 'e228107b-8660-4388-bbf5-5908a34e12f3'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:15:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:15:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:02 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d250f60-f0e2-4f2e-857b-7c371f7e34ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:15:02 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[618eea3c-8cab-484e-8aaa-96e77e0f0747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3] added
Jul 24 18:15:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[be568a2e-84f4-4982-a5db-231ba2d37ac9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[119fce8c-202f-49b5-bbc8-c0b5a9b08668]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwmhcAlI {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwmhcAlI" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f29d5-60e1-4587-925a-ec893c8c3285]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TwmhcAlI'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb95a0-dd57-4c8c-86b1-edaaa16c9744]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ff8d4-a49c-4a9f-bbc1-6f56c0063d92]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:15:02 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:15:02 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:02 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 18:15:02 user nova-compute[70375]: 
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf41135-9a17-4abf-bf0d-ab4f407c1856]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]
Jul 24 18:15:02 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.
Jul 24 18:15:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df63892-d116-46a8-8abc-fa5dc6b992a7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[369aa57c-9a0f-4b11-a8c7-aeed4a74623b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:02 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf78653-3c35-4ca4-be5f-fe6bf11c8b82]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated VIF entry in instance network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG nova.network.neutron [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-05c79229-622b-40dc-bef5-9402337d1428 req-b214d470-ca21-4e37-9296-e79c8dd06d18 service nova] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23930356230373966', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930356230373966', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1849990656',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:14:54Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.objects.instance [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'pci_devices' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:15:03 user nova-compute[70375]:   <uuid>36962cd1-8583-4e95-99a2-f9348a02fa13</uuid>
Jul 24 18:15:03 user nova-compute[70375]:   <name>instance-00000028</name>
Jul 24 18:15:03 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:15:03 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:15:03 user nova-compute[70375]:   <metadata>
Jul 24 18:15:03 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:15:03 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:15:03 user nova-compute[70375]:       <nova:name>tempest-TestShelveInstance-server-331062950</nova:name>
Jul 24 18:15:03 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:15:02</nova:creationTime>
Jul 24 18:15:03 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:15:03 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:15:03 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:15:03 user nova-compute[70375]:       <nova:owner>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:user uuid="67e8bd01c81943eea6f2b9832b0de6f9">tempest-TestShelveInstance-1919161037-project-member</nova:user>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:project uuid="f662a5b1ca8a47c29d28166c88f1b367">tempest-TestShelveInstance-1919161037</nova:project>
Jul 24 18:15:03 user nova-compute[70375]:       </nova:owner>
Jul 24 18:15:03 user nova-compute[70375]:       <nova:ports>
Jul 24 18:15:03 user nova-compute[70375]:         <nova:port uuid="1e56b02e-951c-4db9-ab39-0a0fc6fbf456">
Jul 24 18:15:03 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 18:15:03 user nova-compute[70375]:         </nova:port>
Jul 24 18:15:03 user nova-compute[70375]:       </nova:ports>
Jul 24 18:15:03 user nova-compute[70375]:     </nova:instance>
Jul 24 18:15:03 user nova-compute[70375]:   </metadata>
Jul 24 18:15:03 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:15:03 user nova-compute[70375]:     <system>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="serial">36962cd1-8583-4e95-99a2-f9348a02fa13</entry>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="uuid">36962cd1-8583-4e95-99a2-f9348a02fa13</entry>
Jul 24 18:15:03 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:15:03 user nova-compute[70375]:     </system>
Jul 24 18:15:03 user nova-compute[70375]:   </sysinfo>
Jul 24 18:15:03 user nova-compute[70375]:   <os>
Jul 24 18:15:03 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:15:03 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:15:03 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:15:03 user nova-compute[70375]:   </os>
Jul 24 18:15:03 user nova-compute[70375]:   <features>
Jul 24 18:15:03 user nova-compute[70375]:     <acpi/>
Jul 24 18:15:03 user nova-compute[70375]:     <apic/>
Jul 24 18:15:03 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:15:03 user nova-compute[70375]:   </features>
Jul 24 18:15:03 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:15:03 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:15:03 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:15:03 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:15:03 user nova-compute[70375]:   </clock>
Jul 24 18:15:03 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:15:03 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:15:03 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:15:03 user nova-compute[70375]:   </cpu>
Jul 24 18:15:03 user nova-compute[70375]:   <devices>
Jul 24 18:15:03 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:15:03 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:15:03 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:15:03 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:15:03 user nova-compute[70375]:       <serial>e228107b-8660-4388-bbf5-5908a34e12f3</serial>
Jul 24 18:15:03 user nova-compute[70375]:     </disk>
Jul 24 18:15:03 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:15:03 user nova-compute[70375]:       <mac address="fa:16:3e:09:40:8f"/>
Jul 24 18:15:03 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:03 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:15:03 user nova-compute[70375]:       <target dev="tap1e56b02e-95"/>
Jul 24 18:15:03 user nova-compute[70375]:     </interface>
Jul 24 18:15:03 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:15:03 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13/console.log" append="off"/>
Jul 24 18:15:03 user nova-compute[70375]:     </serial>
Jul 24 18:15:03 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:15:03 user nova-compute[70375]:     <video>
Jul 24 18:15:03 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:03 user nova-compute[70375]:     </video>
Jul 24 18:15:03 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:15:03 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:15:03 user nova-compute[70375]:     </rng>
Jul 24 18:15:03 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:15:03 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:15:03 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:15:03 user nova-compute[70375]:     </memballoon>
Jul 24 18:15:03 user nova-compute[70375]:   </devices>
Jul 24 18:15:03 user nova-compute[70375]: </domain>
Jul 24 18:15:03 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1849990656',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:14:54Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG os_vif [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e56b02e-95, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e56b02e-95, col_values=(('external_ids', {'iface-id': '1e56b02e-951c-4db9-ab39-0a0fc6fbf456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:40:8f', 'vm-uuid': '36962cd1-8583-4e95-99a2-f9348a02fa13'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:03 user nova-compute[70375]: INFO os_vif [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95')
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:15:03 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] No VIF found with MAC fa:16:3e:09:40:8f, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:15:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:05 user nova-compute[70375]: WARNING nova.compute.manager [req-152b5407-6515-4629-a2b5-0650c4bf329c req-8a563558-b847-4ab5-9f4f-ee3226e73167 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 18:15:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:15:05 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:05 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:05 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c44011-c32c-44d6-bfe9-5239f36b0375]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:15:05 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52d752-3601-4709-9bdb-7bed5b585359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f] added
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b9594-40b9-4e82-892b-16950b8db025]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f831187-0616-4bb6-a540-f64024c9591b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMuFTzDm {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMuFTzDm" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf85f42-d164-422a-bc33-397a4a3f5e48]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMuFTzDm'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf0a57-feaf-4f41-938d-748c71796320]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cbdb95-c496-4528-b538-0a951a3aa091]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca363aa-899b-4b14-b179-57c1a0f40b3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]
Jul 24 18:15:05 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c168d-6b28-4713-9f07-4c4480424229]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[468546fb-2f5e-4016-a01f-c788d8b3a3ad]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:05 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:05 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:05 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[051c7a23-327a-4fde-9b95-a71b3ad34e93]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:05 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222491.3266382, aeee2694-42b5-4d45-94c0-0e454bb4a60a => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:06 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] VM Stopped (Lifecycle Event)
Jul 24 18:15:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c14c8a1f-eb36-449a-9a72-32de1d41b3df None None] [instance: aeee2694-42b5-4d45-94c0-0e454bb4a60a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26161643066636566', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161643066636566', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:15:06 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:15:06 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 18:15:06 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:15:06 user nova-compute[70375]:   <serial>2a6d7f61-7355-4468-b9ef-2626b3f2ed8f</serial>
Jul 24 18:15:06 user nova-compute[70375]: </disk>
Jul 24 18:15:06 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222507.0592234, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Resumed (Lifecycle Event)
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:15:07 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance spawned successfully.
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222507.0606267, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:07 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Started (Lifecycle Event)
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38f5ee5a-c52b-48fd-a4a1-f15d9baa487a tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.921s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:07 user nova-compute[70375]: WARNING nova.compute.manager [req-0eb03b07-7495-44c0-8297-c80935aec67b req-b3f42499-4a65-4e09-bdfe-af51d690314f service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state active and task_state None.
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No VIF found with MAC fa:16:3e:cc:6a:95, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-99f76929-a64d-4310-975f-6f114c976177 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.376s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70375) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG nova.compute.manager [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:08 user nova-compute[70375]: WARNING nova.compute.manager [req-c36cd7bf-197d-4723-b216-14c0259ffd95 req-7c119cac-2440-42ab-8ad2-ee3fb1b5f7a1 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state active and task_state powering-off.
Jul 24 18:15:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance destroyed successfully.
Jul 24 18:15:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3be2703b-3695-4faf-8c7d-d6f52e826c63 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.897s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:10 user nova-compute[70375]: WARNING nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:10 user nova-compute[70375]: WARNING nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:10 user nova-compute[70375]: WARNING nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:10 user nova-compute[70375]: WARNING nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:10 user nova-compute[70375]: DEBUG nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:10 user nova-compute[70375]: WARNING nova.compute.manager [req-45c285b5-44d2-4d7f-ac36-91fbc736de2a req-fad71cad-49b7-420c-b781-1571611b7d02 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:15:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:12 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222497.373096, d5a0ab25-5dc8-481b-9101-98318f72dab5 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:12 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] VM Stopped (Lifecycle Event)
Jul 24 18:15:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fead7964-5418-4aa0-821a-12d1e4dfcc3c None None] [instance: d5a0ab25-5dc8-481b-9101-98318f72dab5] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:15:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:23 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222508.5971973, c10a72e2-3387-47f7-938e-57f69b58c887 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:23 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Stopped (Lifecycle Event)
Jul 24 18:15:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-64a2ac10-193f-4664-8647-f60aa9312524 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-64a2ac10-193f-4664-8647-f60aa9312524 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:15:34 user nova-compute[70375]: INFO nova.compute.claims [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Claim successful on node user
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:15:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.policy [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65334a0d26ca4007b4214f0eaf69bb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898cf4400f1426493ed139b25fb7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:15:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Creating image(s)
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.162s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk 1073741824" returned: 0 in 0.047s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Successfully created port: 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Cannot resize image /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'migration_context' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Ensure instance console log exists: /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Successfully updated port: 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing instance network info cache due to event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance network_info: |[{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start _get_guest_xml network_info=[{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:15:36 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:36 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxLRWeub8LXeA2aRnN1YTbmeE9JdTITH7YxBkLzSJL+bLCerRCesS66EtMfIjW7hh6NRso0f4RSYUCYtFmExoRNO1vDwFkfHPkEU0SSgUqaPz3HBkVqKh4yWPkZfoFbhg==',key_name='tempest-keypair-547467386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.objects.instance [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_devices' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:15:36 user nova-compute[70375]:   <uuid>a0176d15-d012-4d0f-8374-73926407c0af</uuid>
Jul 24 18:15:36 user nova-compute[70375]:   <name>instance-0000002b</name>
Jul 24 18:15:36 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:15:36 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:15:36 user nova-compute[70375]:   <metadata>
Jul 24 18:15:36 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:15:36 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-611132264</nova:name>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:15:36</nova:creationTime>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:15:36 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:15:36 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:owner>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:user uuid="65334a0d26ca4007b4214f0eaf69bb17">tempest-AttachVolumeShelveTestJSON-485068176-project-member</nova:user>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:project uuid="0898cf4400f1426493ed139b25fb7d56">tempest-AttachVolumeShelveTestJSON-485068176</nova:project>
Jul 24 18:15:36 user nova-compute[70375]:       </nova:owner>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:15:36 user nova-compute[70375]:       <nova:ports>
Jul 24 18:15:36 user nova-compute[70375]:         <nova:port uuid="47a7a498-24cf-4fe5-b363-2a7d7bf3ceee">
Jul 24 18:15:36 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 18:15:36 user nova-compute[70375]:         </nova:port>
Jul 24 18:15:36 user nova-compute[70375]:       </nova:ports>
Jul 24 18:15:36 user nova-compute[70375]:     </nova:instance>
Jul 24 18:15:36 user nova-compute[70375]:   </metadata>
Jul 24 18:15:36 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:15:36 user nova-compute[70375]:     <system>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="serial">a0176d15-d012-4d0f-8374-73926407c0af</entry>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="uuid">a0176d15-d012-4d0f-8374-73926407c0af</entry>
Jul 24 18:15:36 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:15:36 user nova-compute[70375]:     </system>
Jul 24 18:15:36 user nova-compute[70375]:   </sysinfo>
Jul 24 18:15:36 user nova-compute[70375]:   <os>
Jul 24 18:15:36 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:15:36 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:15:36 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:15:36 user nova-compute[70375]:   </os>
Jul 24 18:15:36 user nova-compute[70375]:   <features>
Jul 24 18:15:36 user nova-compute[70375]:     <acpi/>
Jul 24 18:15:36 user nova-compute[70375]:     <apic/>
Jul 24 18:15:36 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:15:36 user nova-compute[70375]:   </features>
Jul 24 18:15:36 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:15:36 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:15:36 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:15:36 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:15:36 user nova-compute[70375]:   </clock>
Jul 24 18:15:36 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:15:36 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:15:36 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:15:36 user nova-compute[70375]:   </cpu>
Jul 24 18:15:36 user nova-compute[70375]:   <devices>
Jul 24 18:15:36 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:15:36 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:15:36 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk"/>
Jul 24 18:15:36 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:15:36 user nova-compute[70375]:     </disk>
Jul 24 18:15:36 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:15:36 user nova-compute[70375]:       <mac address="fa:16:3e:94:1a:d5"/>
Jul 24 18:15:36 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:36 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:15:36 user nova-compute[70375]:       <target dev="tap47a7a498-24"/>
Jul 24 18:15:36 user nova-compute[70375]:     </interface>
Jul 24 18:15:36 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:15:36 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/console.log" append="off"/>
Jul 24 18:15:36 user nova-compute[70375]:     </serial>
Jul 24 18:15:36 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:15:36 user nova-compute[70375]:     <video>
Jul 24 18:15:36 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:36 user nova-compute[70375]:     </video>
Jul 24 18:15:36 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:15:36 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:15:36 user nova-compute[70375]:     </rng>
Jul 24 18:15:36 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:15:36 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:15:36 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:15:36 user nova-compute[70375]:     </memballoon>
Jul 24 18:15:36 user nova-compute[70375]:   </devices>
Jul 24 18:15:36 user nova-compute[70375]: </domain>
Jul 24 18:15:36 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxLRWeub8LXeA2aRnN1YTbmeE9JdTITH7YxBkLzSJL+bLCerRCesS66EtMfIjW7hh6NRso0f4RSYUCYtFmExoRNO1vDwFkfHPkEU0SSgUqaPz3HBkVqKh4yWPkZfoFbhg==',key_name='tempest-keypair-547467386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG os_vif [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47a7a498-24, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47a7a498-24, col_values=(('external_ids', {'iface-id': '47a7a498-24cf-4fe5-b363-2a7d7bf3ceee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:1a:d5', 'vm-uuid': 'a0176d15-d012-4d0f-8374-73926407c0af'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:36 user nova-compute[70375]: INFO os_vif [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24')
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No VIF found with MAC fa:16:3e:94:1a:d5, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updated VIF entry in instance network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:15:36 user nova-compute[70375]: DEBUG nova.network.neutron [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-78ef90f6-e7de-4aad-b823-c6fb2eea1d04 req-95dff2c3-3e69-4f91-a54d-e23c3e15f8b9 service nova] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:37 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:38 user nova-compute[70375]: WARNING nova.compute.manager [req-94ef3239-04b8-4398-827a-7ee1f5796543 req-e3e99006-5e41-4577-802c-05d363c06ca2 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state building and task_state spawning.
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222540.0901768, a0176d15-d012-4d0f-8374-73926407c0af => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Resumed (Lifecycle Event)
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance spawned successfully.
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222540.0934048, a0176d15-d012-4d0f-8374-73926407c0af => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Started (Lifecycle Event)
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Took 5.33 seconds to spawn the instance on the hypervisor.
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:40 user nova-compute[70375]: INFO nova.compute.manager [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Took 5.84 seconds to build instance.
Jul 24 18:15:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-5350f2f7-8c6f-4c6c-8244-ce30ad311af6 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.929s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:40 user nova-compute[70375]: WARNING nova.compute.manager [req-7d306e94-f0fa-4766-ba9c-6f1d2e7a9c30 req-1b83168d-efae-4d3a-973a-605b906804b4 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state active and task_state None.
Jul 24 18:15:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:15:42 user nova-compute[70375]: INFO nova.compute.claims [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Claim successful on node user
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:15:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:15:42 user nova-compute[70375]: INFO nova.virt.block_device [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Booting with volume 4e031d59-f636-40fa-8ebd-74ab04beb298 at /dev/vda
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.policy [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a2a5d-2966-42b1-9a06-aaaa287a1df1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cdacec-ac26-461c-9d07-34e1f0ea946d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b4fba-0507-47a4-ba53-b9252fe93deb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04921ee-08a8-4bb7-b157-91d8d4c0ada3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:15:42 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:15:42 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5282a4f-bea3-4616-bab9-cb24cec8ac45]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG os_brick.utils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:15:42 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating existing volume attachment record: 87ff490b-5424-44dc-9813-baed31b586d5 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:15:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Successfully created port: ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Successfully updated port: ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Skipping network cache update for instance because it is Building. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing instance network info cache due to event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] Acquiring lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Instance network_info: |[{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] Acquired lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:15:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updated VIF entry in instance network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:15:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:15:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6524d71c-88e8-4a71-bcea-8cf16da63cbf req-a73cfc9f-7070-40c1-a040-253fb9215c44 service nova] Releasing lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:15:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:15:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:15:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Creating image(s)
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Ensure instance console log exists: /opt/stack/data/nova/instances/715b366b-3deb-4fa0-81db-b2ac63daea7e/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Start _get_guest_xml network_info=[{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '87ff490b-5424-44dc-9813-baed31b586d5', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '715b366b-3deb-4fa0-81db-b2ac63daea7e', 'attached_at': '', 'detached_at': '', 'volume_id': '4e031d59-f636-40fa-8ebd-74ab04beb298', 'serial': '4e031d59-f636-40fa-8ebd-74ab04beb298'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:15:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:50 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:15:50 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:50 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:15:50 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaec96f-ef50-4a17-8450-443870f15393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:15:50 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d0c10-84ff-49bf-8124-29d5771145e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298] added
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[be23c892-75df-4bce-b175-53b343c96bb5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c23669d-4364-4bf4-ac8b-0c4e8f91135b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIyrBcWm {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIyrBcWm" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6170d310-4e9a-4394-89f9-5f8caa8d2dd4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIyrBcWm'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e778ce-12c1-418f-8224-ffe4776fe311]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[48815e06-e35b-4017-b4fc-97e71da37f8c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9940ef-9c86-486c-a347-54d5f1dd9137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]
Jul 24 18:15:50 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5c1c9-129b-4f9b-af94-1c1ccaaaa498]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b718b-26aa-4705-8f1c-df5447aa9ed6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:15:50 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:15:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7397ae3c-5f7c-48f5-9e3a-8cd837ee575c]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:15:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23130326430653430', 'path': '/dev/sdd'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130326430653430', 'path': '/dev/sdd'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163632340',display_name='tempest-TestVolumeBootPattern-server-163632340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163632340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-r7d4t16y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:15:43Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=715b366b-3deb-4fa0-81db-b2ac63daea7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid 715b366b-3deb-4fa0-81db-b2ac63daea7e {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:15:51 user nova-compute[70375]:   <uuid>715b366b-3deb-4fa0-81db-b2ac63daea7e</uuid>
Jul 24 18:15:51 user nova-compute[70375]:   <name>instance-0000002c</name>
Jul 24 18:15:51 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:15:51 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:15:51 user nova-compute[70375]:   <metadata>
Jul 24 18:15:51 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:15:51 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:15:51 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-server-163632340</nova:name>
Jul 24 18:15:51 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:15:50</nova:creationTime>
Jul 24 18:15:51 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:15:51 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:15:51 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:15:51 user nova-compute[70375]:       <nova:owner>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:15:51 user nova-compute[70375]:       </nova:owner>
Jul 24 18:15:51 user nova-compute[70375]:       <nova:ports>
Jul 24 18:15:51 user nova-compute[70375]:         <nova:port uuid="ee0c2022-83af-4d97-aea8-4e2c51264d24">
Jul 24 18:15:51 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 18:15:51 user nova-compute[70375]:         </nova:port>
Jul 24 18:15:51 user nova-compute[70375]:       </nova:ports>
Jul 24 18:15:51 user nova-compute[70375]:     </nova:instance>
Jul 24 18:15:51 user nova-compute[70375]:   </metadata>
Jul 24 18:15:51 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:15:51 user nova-compute[70375]:     <system>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="serial">715b366b-3deb-4fa0-81db-b2ac63daea7e</entry>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="uuid">715b366b-3deb-4fa0-81db-b2ac63daea7e</entry>
Jul 24 18:15:51 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:15:51 user nova-compute[70375]:     </system>
Jul 24 18:15:51 user nova-compute[70375]:   </sysinfo>
Jul 24 18:15:51 user nova-compute[70375]:   <os>
Jul 24 18:15:51 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:15:51 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:15:51 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:15:51 user nova-compute[70375]:   </os>
Jul 24 18:15:51 user nova-compute[70375]:   <features>
Jul 24 18:15:51 user nova-compute[70375]:     <acpi/>
Jul 24 18:15:51 user nova-compute[70375]:     <apic/>
Jul 24 18:15:51 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:15:51 user nova-compute[70375]:   </features>
Jul 24 18:15:51 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:15:51 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:15:51 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:15:51 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:15:51 user nova-compute[70375]:   </clock>
Jul 24 18:15:51 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:15:51 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:15:51 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:15:51 user nova-compute[70375]:   </cpu>
Jul 24 18:15:51 user nova-compute[70375]:   <devices>
Jul 24 18:15:51 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:15:51 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:15:51 user nova-compute[70375]:       <source dev="/dev/sdd"/>
Jul 24 18:15:51 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:15:51 user nova-compute[70375]:       <serial>4e031d59-f636-40fa-8ebd-74ab04beb298</serial>
Jul 24 18:15:51 user nova-compute[70375]:     </disk>
Jul 24 18:15:51 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:15:51 user nova-compute[70375]:       <mac address="fa:16:3e:f2:43:1e"/>
Jul 24 18:15:51 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:51 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:15:51 user nova-compute[70375]:       <target dev="tapee0c2022-83"/>
Jul 24 18:15:51 user nova-compute[70375]:     </interface>
Jul 24 18:15:51 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:15:51 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/715b366b-3deb-4fa0-81db-b2ac63daea7e/console.log" append="off"/>
Jul 24 18:15:51 user nova-compute[70375]:     </serial>
Jul 24 18:15:51 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:15:51 user nova-compute[70375]:     <video>
Jul 24 18:15:51 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:15:51 user nova-compute[70375]:     </video>
Jul 24 18:15:51 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:15:51 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:15:51 user nova-compute[70375]:     </rng>
Jul 24 18:15:51 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:15:51 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:15:51 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:15:51 user nova-compute[70375]:     </memballoon>
Jul 24 18:15:51 user nova-compute[70375]:   </devices>
Jul 24 18:15:51 user nova-compute[70375]: </domain>
Jul 24 18:15:51 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163632340',display_name='tempest-TestVolumeBootPattern-server-163632340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163632340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-r7d4t16y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:15:43Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=715b366b-3deb-4fa0-81db-b2ac63daea7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG os_vif [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0c2022-83, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0c2022-83, col_values=(('external_ids', {'iface-id': 'ee0c2022-83af-4d97-aea8-4e2c51264d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:43:1e', 'vm-uuid': '715b366b-3deb-4fa0-81db-b2ac63daea7e'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:51 user nova-compute[70375]: INFO os_vif [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83')
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:15:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:f2:43:1e, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:15:52 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:52 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=24.254127502441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 36962cd1-8583-4e95-99a2-f9348a02fa13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a0176d15-d012-4d0f-8374-73926407c0af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 715b366b-3deb-4fa0-81db-b2ac63daea7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:15:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] No waiting events found dispatching network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:53 user nova-compute[70375]: WARNING nova.compute.manager [req-d9e5e21d-2311-42fc-bc19-07412b3c9db0 req-bdcbdda2-8021-4f9f-aaad-f54dee7b087f service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received unexpected event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 for instance with vm_state building and task_state spawning.
Jul 24 18:15:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222555.5123138, 715b366b-3deb-4fa0-81db-b2ac63daea7e => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] VM Resumed (Lifecycle Event)
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Instance spawned successfully.
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222555.5167823, 715b366b-3deb-4fa0-81db-b2ac63daea7e => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] VM Started (Lifecycle Event)
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Took 5.29 seconds to spawn the instance on the hypervisor.
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:15:55 user nova-compute[70375]: INFO nova.compute.manager [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Took 13.50 seconds to build instance.
Jul 24 18:15:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f6b8a2ff-66e6-4d48-9ba5-120363f29295 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.603s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:15:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] No waiting events found dispatching network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:15:55 user nova-compute[70375]: WARNING nova.compute.manager [req-6fa54340-89e6-4c65-961f-6d5169c86496 req-082d851c-7db2-4295-b101-466a5ad6ba84 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received unexpected event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 for instance with vm_state active and task_state None.
Jul 24 18:15:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:15:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:16:05 user nova-compute[70375]: INFO nova.compute.claims [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Claim successful on node user
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:16:05 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.policy [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887e0d1db9494dcf94fcdc587babd25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8ea79ad686442ba582dbac9814ed3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:16:05 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Creating image(s)
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "/opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "/opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "/opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.200s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:05 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk 1073741824" returned: 0 in 0.065s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Cannot resize image /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'migration_context' on Instance uuid 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Successfully created port: 047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Ensure instance console log exists: /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Successfully updated port: 047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquired lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-changed-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.compute.manager [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Refreshing instance network info cache due to event network-changed-047ef696-b83d-4c5e-9c95-05994547a50d. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] Acquiring lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.neutron [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Updating instance_info_cache with network_info: [{"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Releasing lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Instance network_info: |[{"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] Acquired lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.neutron [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Refreshing network info cache for port 047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Start _get_guest_xml network_info=[{"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:16:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307318011',display_name='tempest-VolumesActionsTest-instance-307318011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307318011',id=45,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-dn6fl6qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:16:06Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.objects.instance [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:16:07 user nova-compute[70375]:   <uuid>90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2</uuid>
Jul 24 18:16:07 user nova-compute[70375]:   <name>instance-0000002d</name>
Jul 24 18:16:07 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:16:07 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:16:07 user nova-compute[70375]:   <metadata>
Jul 24 18:16:07 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:16:07 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:name>tempest-VolumesActionsTest-instance-307318011</nova:name>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:16:07</nova:creationTime>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:16:07 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:16:07 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:owner>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:user uuid="887e0d1db9494dcf94fcdc587babd25b">tempest-VolumesActionsTest-388853914-project-member</nova:user>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:project uuid="ee8ea79ad686442ba582dbac9814ed3b">tempest-VolumesActionsTest-388853914</nova:project>
Jul 24 18:16:07 user nova-compute[70375]:       </nova:owner>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:16:07 user nova-compute[70375]:       <nova:ports>
Jul 24 18:16:07 user nova-compute[70375]:         <nova:port uuid="047ef696-b83d-4c5e-9c95-05994547a50d">
Jul 24 18:16:07 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 18:16:07 user nova-compute[70375]:         </nova:port>
Jul 24 18:16:07 user nova-compute[70375]:       </nova:ports>
Jul 24 18:16:07 user nova-compute[70375]:     </nova:instance>
Jul 24 18:16:07 user nova-compute[70375]:   </metadata>
Jul 24 18:16:07 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:16:07 user nova-compute[70375]:     <system>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="serial">90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2</entry>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="uuid">90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2</entry>
Jul 24 18:16:07 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:16:07 user nova-compute[70375]:     </system>
Jul 24 18:16:07 user nova-compute[70375]:   </sysinfo>
Jul 24 18:16:07 user nova-compute[70375]:   <os>
Jul 24 18:16:07 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:16:07 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:16:07 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:16:07 user nova-compute[70375]:   </os>
Jul 24 18:16:07 user nova-compute[70375]:   <features>
Jul 24 18:16:07 user nova-compute[70375]:     <acpi/>
Jul 24 18:16:07 user nova-compute[70375]:     <apic/>
Jul 24 18:16:07 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:16:07 user nova-compute[70375]:   </features>
Jul 24 18:16:07 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:16:07 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:16:07 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:16:07 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:16:07 user nova-compute[70375]:   </clock>
Jul 24 18:16:07 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:16:07 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:16:07 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:16:07 user nova-compute[70375]:   </cpu>
Jul 24 18:16:07 user nova-compute[70375]:   <devices>
Jul 24 18:16:07 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:16:07 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:16:07 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk"/>
Jul 24 18:16:07 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:16:07 user nova-compute[70375]:     </disk>
Jul 24 18:16:07 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:16:07 user nova-compute[70375]:       <mac address="fa:16:3e:6d:45:ca"/>
Jul 24 18:16:07 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:16:07 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:16:07 user nova-compute[70375]:       <target dev="tap047ef696-b8"/>
Jul 24 18:16:07 user nova-compute[70375]:     </interface>
Jul 24 18:16:07 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:16:07 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/console.log" append="off"/>
Jul 24 18:16:07 user nova-compute[70375]:     </serial>
Jul 24 18:16:07 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:16:07 user nova-compute[70375]:     <video>
Jul 24 18:16:07 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:16:07 user nova-compute[70375]:     </video>
Jul 24 18:16:07 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:16:07 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:16:07 user nova-compute[70375]:     </rng>
Jul 24 18:16:07 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:16:07 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:16:07 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:16:07 user nova-compute[70375]:     </memballoon>
Jul 24 18:16:07 user nova-compute[70375]:   </devices>
Jul 24 18:16:07 user nova-compute[70375]: </domain>
Jul 24 18:16:07 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307318011',display_name='tempest-VolumesActionsTest-instance-307318011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307318011',id=45,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-dn6fl6qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:16:06Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG os_vif [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap047ef696-b8, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap047ef696-b8, col_values=(('external_ids', {'iface-id': '047ef696-b83d-4c5e-9c95-05994547a50d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:45:ca', 'vm-uuid': '90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:07 user nova-compute[70375]: INFO os_vif [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8')
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:16:07 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] No VIF found with MAC fa:16:3e:6d:45:ca, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:16:08 user nova-compute[70375]: DEBUG nova.network.neutron [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Updated VIF entry in instance network info cache for port 047ef696-b83d-4c5e-9c95-05994547a50d. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:16:08 user nova-compute[70375]: DEBUG nova.network.neutron [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Updating instance_info_cache with network_info: [{"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8717ac06-6ebf-46f7-a408-a2506ae57c50 req-0840516e-8510-4819-b02b-498e6c2538d4 service nova] Releasing lock "refresh_cache-90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] No waiting events found dispatching network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:16:09 user nova-compute[70375]: WARNING nova.compute.manager [req-12b3c12c-ae40-4f76-a1cc-d06761b7deff req-218e4fc9-43a2-4188-b5d7-305f24f5dbe8 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received unexpected event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d for instance with vm_state building and task_state spawning.
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222571.317902, 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] VM Resumed (Lifecycle Event)
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Instance spawned successfully.
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222571.321717, 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] VM Started (Lifecycle Event)
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:16:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Took 5.85 seconds to spawn the instance on the hypervisor.
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:11 user nova-compute[70375]: DEBUG nova.compute.manager [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] No waiting events found dispatching network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:16:11 user nova-compute[70375]: WARNING nova.compute.manager [req-9cd4157f-61bb-4740-8c9d-6eba550f9c56 req-58772d1a-2c1a-4ba1-a3de-7b8a07e885d6 service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received unexpected event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d for instance with vm_state building and task_state spawning.
Jul 24 18:16:11 user nova-compute[70375]: INFO nova.compute.manager [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Took 6.40 seconds to build instance.
Jul 24 18:16:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-70aa9841-88b8-4644-ba61-832bfa663a5e tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.486s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:40 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing instance network info cache due to event network-changed-1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] Acquiring lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] Acquired lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Refreshing network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:45 user nova-compute[70375]: INFO nova.compute.manager [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Terminating instance
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [req-3832de9e-2aed-4c8b-b95a-4ef8a01a1169 req-51b18aa4-cd0c-4bb1-b341-94386895bedf service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-unplugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updated VIF entry in instance network info cache for port 1e56b02e-951c-4db9-ab39-0a0fc6fbf456. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG nova.network.neutron [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [{"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cf3614a4-be62-4b7e-9180-d11e07eba7f8 req-d92e3022-8833-4f88-bb42-59f7d0ad9782 service nova] Releasing lock "refresh_cache-36962cd1-8583-4e95-99a2-f9348a02fa13" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:16:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Instance destroyed successfully.
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lazy-loading 'resources' on Instance uuid 36962cd1-8583-4e95-99a2-f9348a02fa13 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-331062950',display_name='tempest-TestShelveInstance-server-331062950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-331062950',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZbHjMQTEpcm2PnfEBNF2Te0+DVtjCpZ3qvnIb5pGOdeOvMhLwk9tUOIvFPtiFZcCzK0a0/kGk4VRG2qa25LLD315t/IH+Yv8Utcufm7ArLKVyQsy2RrFPatFdUoTBXA==',key_name='tempest-TestShelveInstance-1849990656',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f662a5b1ca8a47c29d28166c88f1b367',ramdisk_id='',reservation_id='r-s03vbme2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1919161037',owner_user_name='tempest-TestShelveInstance-1919161037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:15:07Z,user_data=None,user_id='67e8bd01c81943eea6f2b9832b0de6f9',uuid=36962cd1-8583-4e95-99a2-f9348a02fa13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converting VIF {"id": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "address": "fa:16:3e:09:40:8f", "network": {"id": "1f683d02-4b2c-4e2a-8eef-e10157cbe4ea", "bridge": "br-int", "label": "tempest-TestShelveInstance-223881967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f662a5b1ca8a47c29d28166c88f1b367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e56b02e-95", "ovs_interfaceid": "1e56b02e-951c-4db9-ab39-0a0fc6fbf456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_vif [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e56b02e-95, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:46 user nova-compute[70375]: INFO os_vif [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:40:8f,bridge_name='br-int',has_traffic_filtering=True,id=1e56b02e-951c-4db9-ab39-0a0fc6fbf456,network=Network(1f683d02-4b2c-4e2a-8eef-e10157cbe4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e56b02e-95')
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwmhcAlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:16:46 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc76210-2109-42e0-a36e-f349461bd31e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:16:46 user nova-compute[70375]: No targets found.
Jul 24 18:16:46 user nova-compute[70375]: iSNS:
Jul 24 18:16:46 user nova-compute[70375]: No targets found.
Jul 24 18:16:46 user nova-compute[70375]: STATIC:
Jul 24 18:16:46 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f
Jul 24 18:16:46 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:16:46 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:16:46 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3
Jul 24 18:16:46 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:16:46 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:16:46 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:16:46 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:16:46 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:16:46 user nova-compute[70375]: FIRMWARE:
Jul 24 18:16:46 user nova-compute[70375]: No targets found.
Jul 24 18:16:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:16:46 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:16:46 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab937422-4dd7-4d4c-be9f-9f5478976e4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[732d4b89-569c-4303-93f1-938989603953]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:16:46 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:16:46 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:16:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 (non-flash)
Jul 24 18:16:46 user nova-compute[70375]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:16:46 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:16:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6501b9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077ede9-fb5c-46c2-b679-0123f039319d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[716d8da3-abef-4c37-8c35-c4e1821b91d4]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d14dd-705d-44a8-8b24-eff8361b0edc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[35718e53-55a9-4f21-a67a-f219577d7199]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe2a29598-905b079f1dd0e2da', '/dev/disk/by-id/scsi-23930356230373966', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e2a29598') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf1575-8a85-49d9-b278-a207a6d6d3bf]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea41031-d7a6-48e2-9bc5-ca634ee8e627]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8e31dd-7171-4ea8-822e-75ed9eab6af0]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260]
Jul 24 18:16:46 user nova-compute[70375]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3, portal: 172.16.0.220,3260] successful.
Jul 24 18:16:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e228107b-8660-4388-bbf5-5908a34e12f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc1a4af-96d5-4b42-a084-9fe1518c13b7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] <== disconnect_volume: return (329ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:16:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deleting instance files /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13_del
Jul 24 18:16:46 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deletion of /opt/stack/data/nova/instances/36962cd1-8583-4e95-99a2-f9348a02fa13_del complete
Jul 24 18:16:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:46 user nova-compute[70375]: INFO nova.compute.manager [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 24 18:16:46 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:46 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Took 0.45 seconds to deallocate network for instance.
Jul 24 18:16:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-5b821a48-236d-4c9f-ad2f-6839caca9562 req-e652853d-ec26-4fc6-9d53-38d9983e2be7 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-deleted-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:47 user nova-compute[70375]: INFO nova.compute.manager [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Took 0.76 seconds to detach 1 volumes for instance.
Jul 24 18:16:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Deleting volume: e228107b-8660-4388-bbf5-5908a34e12f3 {{(pid=70375) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] Acquiring lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG nova.compute.manager [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] No waiting events found dispatching network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:16:47 user nova-compute[70375]: WARNING nova.compute.manager [req-8bdfe444-bec4-4364-8c7b-413e496b2793 req-d0486f6c-ecb0-4e81-8763-021de146f1a2 service nova] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Received unexpected event network-vif-plugged-1e56b02e-951c-4db9-ab39-0a0fc6fbf456 for instance with vm_state active and task_state deleting.
Jul 24 18:16:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:48 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Deleted allocations for instance 36962cd1-8583-4e95-99a2-f9348a02fa13
Jul 24 18:16:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:16:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c6779711-e150-40a6-a610-34ccd158f2c8 tempest-TestShelveInstance-1919161037 tempest-TestShelveInstance-1919161037-project-member] Lock "36962cd1-8583-4e95-99a2-f9348a02fa13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.974s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:52 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:52 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8289MB free_disk=24.195026397705078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a0176d15-d012-4d0f-8374-73926407c0af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 715b366b-3deb-4fa0-81db-b2ac63daea7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:16:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:16:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:16:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:16:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:16:58 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'info_cache' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:16:59 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance destroyed successfully.
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'resources' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93758659-46, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:16:59 user nova-compute[70375]: INFO os_vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:16:59 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a6b4c5-c8ba-42fe-8895-4004b7e3bad7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:16:59 user nova-compute[70375]: No targets found.
Jul 24 18:16:59 user nova-compute[70375]: iSNS:
Jul 24 18:16:59 user nova-compute[70375]: No targets found.
Jul 24 18:16:59 user nova-compute[70375]: STATIC:
Jul 24 18:16:59 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f
Jul 24 18:16:59 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:16:59 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:16:59 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:16:59 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:16:59 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:16:59 user nova-compute[70375]: FIRMWARE:
Jul 24 18:16:59 user nova-compute[70375]: No targets found.
Jul 24 18:16:59 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:16:59 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:16:59 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead1b25-9ed3-4469-998f-368344b68e95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b312c9a2-630b-4afe-915f-42d44f421247]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:16:59 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:16:59 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:16:59 user nova-compute[70375]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:16:59 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650193130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc055565-896e-4ac4-8861-9e58c53ac242]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52965dfc-2a52-4aa3-a3b2-b8f053e213d7]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c56527-eb59-4e37-9cd6-182a640288e0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e8699-2f97-43fc-ad04-421e62bdb8cb]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee5f993-c661-45ec-aaee-db6268539ba9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[27772484-2e18-41ff-a33e-cec0c93bf24f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]
Jul 24 18:16:59 user nova-compute[70375]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.
Jul 24 18:16:59 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[36842cfa-9c0f-44cd-8686-f025a0a09593]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== disconnect_volume: return (317ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start _get_guest_xml network_info=[{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4e9c92cc-28e4-4615-b4fb-ba3e6bd60805', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c10a72e2-3387-47f7-938e-57f69b58c887', 'attached_at': '', 'detached_at': '', 'volume_id': '2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'serial': '2a6d7f61-7355-4468-b9ef-2626b3f2ed8f'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'numa_topology' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'vcpu_model' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:16:59 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:16:59 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:16:59 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4158ed1-e383-49e1-b006-b80f3ac6af05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:16:59 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b932b488-0b36-4526-896b-baf40e699c5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f] added
Jul 24 18:16:59 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4174e-5625-418b-bac6-0e78f18ebf97]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08d8e7-676c-4da9-aed3-050d61d494e8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:16:59 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMuFTzDm {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMuFTzDm" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c515453-157e-45e2-9cda-511e2b3dc572]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMuFTzDm'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[75520018-ef06-4015-8892-ed6ac0075f17]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b70618-8c9a-4de2-ad41-04c05ef10bfe]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:00 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:00 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac5a56-8b62-4356-ac39-8f7ada25bfaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]
Jul 24 18:17:00 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.
Jul 24 18:17:00 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b075a46d-e9ed-4e5a-b515-860f9344f992]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8269e694-8a90-4f5d-993f-51621f4c7118]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:00 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:00 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:00 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:00 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6283d-7906-4b4c-8186-5aa4ddb0985f]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:17:00 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222606.0619357, 36962cd1-8583-4e95-99a2-f9348a02fa13 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:17:01 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] VM Stopped (Lifecycle Event)
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-bf6c9792-094c-403e-b3e8-7b39df86c8eb None None] [instance: 36962cd1-8583-4e95-99a2-f9348a02fa13] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26161643066636566', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161643066636566', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'pci_devices' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:17:01 user nova-compute[70375]:   <uuid>c10a72e2-3387-47f7-938e-57f69b58c887</uuid>
Jul 24 18:17:01 user nova-compute[70375]:   <name>instance-0000002a</name>
Jul 24 18:17:01 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:17:01 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:17:01 user nova-compute[70375]:   <metadata>
Jul 24 18:17:01 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:17:01 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeTestJSON-server-1173996728</nova:name>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:16:59</nova:creationTime>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:17:01 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:17:01 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:owner>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:user uuid="e91fc2ae6a3e4ccaa35a33dc589bcb63">tempest-AttachVolumeTestJSON-67425413-project-member</nova:user>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:project uuid="49c98e21a63a49a5817d6bf54d18dcd1">tempest-AttachVolumeTestJSON-67425413</nova:project>
Jul 24 18:17:01 user nova-compute[70375]:       </nova:owner>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:17:01 user nova-compute[70375]:       <nova:ports>
Jul 24 18:17:01 user nova-compute[70375]:         <nova:port uuid="93758659-4637-43ef-b475-16dd6fc2ffb3">
Jul 24 18:17:01 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 18:17:01 user nova-compute[70375]:         </nova:port>
Jul 24 18:17:01 user nova-compute[70375]:       </nova:ports>
Jul 24 18:17:01 user nova-compute[70375]:     </nova:instance>
Jul 24 18:17:01 user nova-compute[70375]:   </metadata>
Jul 24 18:17:01 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:17:01 user nova-compute[70375]:     <system>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="serial">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="uuid">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:17:01 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:17:01 user nova-compute[70375]:     </system>
Jul 24 18:17:01 user nova-compute[70375]:   </sysinfo>
Jul 24 18:17:01 user nova-compute[70375]:   <os>
Jul 24 18:17:01 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:17:01 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:17:01 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:17:01 user nova-compute[70375]:   </os>
Jul 24 18:17:01 user nova-compute[70375]:   <features>
Jul 24 18:17:01 user nova-compute[70375]:     <acpi/>
Jul 24 18:17:01 user nova-compute[70375]:     <apic/>
Jul 24 18:17:01 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:17:01 user nova-compute[70375]:   </features>
Jul 24 18:17:01 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:17:01 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:17:01 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:17:01 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:17:01 user nova-compute[70375]:   </clock>
Jul 24 18:17:01 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:17:01 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:17:01 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:17:01 user nova-compute[70375]:   </cpu>
Jul 24 18:17:01 user nova-compute[70375]:   <devices>
Jul 24 18:17:01 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:17:01 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:17:01 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk"/>
Jul 24 18:17:01 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:17:01 user nova-compute[70375]:     </disk>
Jul 24 18:17:01 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:17:01 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:17:01 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:17:01 user nova-compute[70375]:       <target dev="vdb" bus="virtio"/>
Jul 24 18:17:01 user nova-compute[70375]:       <serial>2a6d7f61-7355-4468-b9ef-2626b3f2ed8f</serial>
Jul 24 18:17:01 user nova-compute[70375]:     </disk>
Jul 24 18:17:01 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:17:01 user nova-compute[70375]:       <mac address="fa:16:3e:cc:6a:95"/>
Jul 24 18:17:01 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:17:01 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:17:01 user nova-compute[70375]:       <target dev="tap93758659-46"/>
Jul 24 18:17:01 user nova-compute[70375]:     </interface>
Jul 24 18:17:01 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:17:01 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/console.log" append="off"/>
Jul 24 18:17:01 user nova-compute[70375]:     </serial>
Jul 24 18:17:01 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:17:01 user nova-compute[70375]:     <video>
Jul 24 18:17:01 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:17:01 user nova-compute[70375]:     </video>
Jul 24 18:17:01 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:17:01 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:17:01 user nova-compute[70375]:     </rng>
Jul 24 18:17:01 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:17:01 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:17:01 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:17:01 user nova-compute[70375]:     </memballoon>
Jul 24 18:17:01 user nova-compute[70375]:   </devices>
Jul 24 18:17:01 user nova-compute[70375]: </domain>
Jul 24 18:17:01 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'trusted_certs' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Cannot resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'migration_context' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG os_vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93758659-46, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93758659-46, col_values=(('external_ids', {'iface-id': '93758659-4637-43ef-b475-16dd6fc2ffb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6a:95', 'vm-uuid': 'c10a72e2-3387-47f7-938e-57f69b58c887'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:01 user nova-compute[70375]: INFO os_vif [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG nova.compute.manager [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:03 user nova-compute[70375]: WARNING nova.compute.manager [req-038c214b-a98e-4d4d-9b95-1f4245da4e26 req-d9c50254-4011-4593-9539-f1f50e87577b service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state powering-on.
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222625.25922, c10a72e2-3387-47f7-938e-57f69b58c887 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:17:05 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Resumed (Lifecycle Event)
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:17:05 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance rebooted successfully.
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b414a351-dacb-42b9-8f04-43355e689053 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:17:05 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222625.2606492, c10a72e2-3387-47f7-938e-57f69b58c887 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:17:05 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Started (Lifecycle Event)
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:05 user nova-compute[70375]: DEBUG nova.compute.manager [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:05 user nova-compute[70375]: WARNING nova.compute.manager [req-671df3a4-c7c3-47d3-8ba8-6462fad843f9 req-cfa4208c-1ad8-4700-8376-47fb12b2c5ae service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state active and task_state None.
Jul 24 18:17:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:17:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:17:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing instance network info cache due to event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updated VIF entry in instance network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb0b0ef-fa00-4841-8228-b9504f071dba req-89c5fbe9-16d8-4828-b47c-edb687cba7a9 service nova] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:17:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:29 user nova-compute[70375]: INFO nova.compute.manager [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Shelving
Jul 24 18:17:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:29 user nova-compute[70375]: WARNING nova.compute.manager [req-1f6c42fe-e222-443b-8889-39aba8b830ff req-003a19e2-64ec-4564-99a7-e2a44149cee6 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state active and task_state shelving.
Jul 24 18:17:29 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance destroyed successfully.
Jul 24 18:17:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:29 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Beginning cold snapshot process
Jul 24 18:17:29 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:17:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk /opt/stack/data/nova/instances/snapshots/tmpqly_ge6m/d13d793cbca4476baeaf4135d8559bba {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk /opt/stack/data/nova/instances/snapshots/tmpqly_ge6m/d13d793cbca4476baeaf4135d8559bba" returned: 0 in 0.672s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:30 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Snapshot extracted, beginning image upload
Jul 24 18:17:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:31 user nova-compute[70375]: WARNING nova.compute.manager [req-250df904-a988-4d1d-b883-4fc486a5cf6c req-6dd26a98-fbd0-4205-b469-121856a010b8 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 18:17:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:32 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Snapshot image upload complete
Jul 24 18:17:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:32 user nova-compute[70375]: INFO nova.compute.manager [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Shelve offloading
Jul 24 18:17:32 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance destroyed successfully.
Jul 24 18:17:32 user nova-compute[70375]: DEBUG nova.compute.manager [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:17:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:17:32 user nova-compute[70375]: DEBUG nova.network.neutron [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:17:34 user nova-compute[70375]: DEBUG nova.network.neutron [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing instance network info cache due to event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] Acquiring lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] Acquired lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.network.neutron [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:17:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance destroyed successfully.
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'resources' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxLRWeub8LXeA2aRnN1YTbmeE9JdTITH7YxBkLzSJL+bLCerRCesS66EtMfIjW7hh6NRso0f4RSYUCYtFmExoRNO1vDwFkfHPkEU0SSgUqaPz3HBkVqKh4yWPkZfoFbhg==',key_name='tempest-keypair-547467386',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:17:32.857286',shelved_host='user',shelved_image_id='7686df83-4f40-432b-abaf-656113baef83'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG os_vif [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47a7a498-24, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:35 user nova-compute[70375]: INFO os_vif [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24')
Jul 24 18:17:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Deleting instance files /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af_del
Jul 24 18:17:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Deletion of /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af_del complete
Jul 24 18:17:35 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Deleted allocations for instance a0176d15-d012-4d0f-8374-73926407c0af
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'numa_topology' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.network.neutron [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updated VIF entry in instance network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG nova.network.neutron [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-490656bc-bfeb-464b-b88c-0ae2c15c3576 req-2fee0211-f114-4744-9e12-fb33fd836ae5 service nova] Releasing lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:17:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-67c2f1a8-e7f2-422c-8bdb-a89d85ef9957 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.558s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:44 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222649.5855453, a0176d15-d012-4d0f-8374-73926407c0af => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:17:44 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Stopped (Lifecycle Event)
Jul 24 18:17:44 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3ae50678-7646-4f20-b9e1-cc4646d0c3bb None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:17:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:17:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Skipping network cache update for instance because it has been migrated to another host. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9866}}
Jul 24 18:17:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:46 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:17:46 user nova-compute[70375]: INFO nova.compute.claims [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Claim successful on node user
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:17:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:17:47 user nova-compute[70375]: INFO nova.virt.block_device [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Booting with volume b144408c-394a-43e7-be7f-308c194d5d64 at /dev/vda
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.policy [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73db0166ab6848748b6680624f570ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31b27038d1342519b6660f16785bbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.utils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[12215dc9-112e-47f3-9928-9b854ccd83a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23da35-8e78-4afb-accc-8894fca0f507]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2b1cc-69ab-447f-93e7-ddf2e09fefef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cbac7a-e458-4cd5-aa67-6c8f4cbfc727]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:17:47 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:17:47 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63b1513-9a3b-410c-9c84-56cd26694c60]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG os_brick.utils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:17:47 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating existing volume attachment record: 8db571e9-c2ed-4fa8-843e-18d2632c4a0b {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Successfully created port: f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Successfully updated port: f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquired lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing instance network info cache due to event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] Acquiring lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:17:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating instance_info_cache with network_info: [{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Releasing lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Instance network_info: |[{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] Acquired lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updated VIF entry in instance network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating instance_info_cache with network_info: [{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-40d26d34-1dde-421f-bd7d-30c17de2bb60 req-6b2bd9e4-6dfa-422e-bcc2-ede2c9cb9664 service nova] Releasing lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:17:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:17:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:53 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:54 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:17:54 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8452MB free_disk=24.171123504638672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 715b366b-3deb-4fa0-81db-b2ac63daea7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b40890a1-9404-4341-a82e-2d11818b20a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:17:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:55 user nova-compute[70375]: INFO nova.compute.manager [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Terminating instance
Jul 24 18:17:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-unplugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] No waiting events found dispatching network-vif-unplugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-cbd57692-5d33-4f9e-84b0-7587c7ada341 req-87999d04-dbb7-4513-b166-168be5185ebb service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-unplugged-047ef696-b83d-4c5e-9c95-05994547a50d for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Instance destroyed successfully.
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'resources' on Instance uuid 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307318011',display_name='tempest-VolumesActionsTest-instance-307318011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307318011',id=45,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-dn6fl6qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:16:12Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "047ef696-b83d-4c5e-9c95-05994547a50d", "address": "fa:16:3e:6d:45:ca", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047ef696-b8", "ovs_interfaceid": "047ef696-b83d-4c5e-9c95-05994547a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG os_vif [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap047ef696-b8, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:56 user nova-compute[70375]: INFO os_vif [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=047ef696-b83d-4c5e-9c95-05994547a50d,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047ef696-b8')
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Deleting instance files /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2_del
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Deletion of /opt/stack/data/nova/instances/90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2_del complete
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.compute.manager [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Took 0.43 seconds to deallocate network for instance.
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:56 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Deleted allocations for instance 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2
Jul 24 18:17:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b73ee74e-016e-410d-8946-848a3198e470 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.468s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:17:57 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Creating image(s)
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Did not create local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Ensure instance console log exists: /opt/stack/data/nova/instances/b40890a1-9404-4341-a82e-2d11818b20a7/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Start _get_guest_xml network_info=[{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8db571e9-c2ed-4fa8-843e-18d2632c4a0b', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIdqpVLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b40890a1-9404-4341-a82e-2d11818b20a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b144408c-394a-43e7-be7f-308c194d5d64', 'serial': 'b144408c-394a-43e7-be7f-308c194d5d64'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:17:57 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:17:57 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIdqpVLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:17:57 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:17:57 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:17:57 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[59946fba-facb-4ac7-920e-e0b9af392e89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:17:57 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] Acquiring lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] Lock "90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] No waiting events found dispatching network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:17:57 user nova-compute[70375]: WARNING nova.compute.manager [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received unexpected event network-vif-plugged-047ef696-b83d-4c5e-9c95-05994547a50d for instance with vm_state deleted and task_state None.
Jul 24 18:17:57 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7c02a0e-8cbe-4d11-a3b4-50099128f5c7 req-48dcffc2-8d11-494f-a10b-5513c0a61bdd service nova] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Received event network-vif-deleted-047ef696-b83d-4c5e-9c95-05994547a50d {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[755203bf-6350-471f-94bd-ff01f2b0851d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64] added
Jul 24 18:17:57 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c1615e-928d-4090-93a2-99f542cb53fe]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdbd4a-4648-4e1b-b027-ea534c35adf7]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIdqpVLB {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIdqpVLB" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d0923a-d71f-41d8-bdac-33883d5966b8]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIdqpVLB'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ccb572-b089-41a3-a0c7-42599f05a612]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653758a-4780-4309-aa46-7982f3cdb424]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a4662-6eaa-407e-9030-293a01fa764f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260]
Jul 24 18:17:58 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260] successful.
Jul 24 18:17:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e56f6-d570-4a98-a3d7-14b19423202f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[067f40dc-e0c3-4b4c-a0fe-1e7e68df528c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:17:58 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:17:58 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17aa1bd-a349-469e-8618-11f2c929c2a7]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:17:58 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIdqpVLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26466373530636533', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466373530636533', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1417532518',display_name='tempest-TestVolumeBootPattern-server-1417532518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1417532518',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-8hwo5mz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:17:47Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=b40890a1-9404-4341-a82e-2d11818b20a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'pci_devices' on Instance uuid b40890a1-9404-4341-a82e-2d11818b20a7 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:17:59 user nova-compute[70375]:   <uuid>b40890a1-9404-4341-a82e-2d11818b20a7</uuid>
Jul 24 18:17:59 user nova-compute[70375]:   <name>instance-0000002e</name>
Jul 24 18:17:59 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:17:59 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:17:59 user nova-compute[70375]:   <metadata>
Jul 24 18:17:59 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:17:59 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:17:59 user nova-compute[70375]:       <nova:name>tempest-TestVolumeBootPattern-server-1417532518</nova:name>
Jul 24 18:17:59 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:17:57</nova:creationTime>
Jul 24 18:17:59 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:17:59 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:17:59 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:17:59 user nova-compute[70375]:       <nova:owner>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:user uuid="73db0166ab6848748b6680624f570ead">tempest-TestVolumeBootPattern-728863810-project-member</nova:user>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:project uuid="e31b27038d1342519b6660f16785bbaa">tempest-TestVolumeBootPattern-728863810</nova:project>
Jul 24 18:17:59 user nova-compute[70375]:       </nova:owner>
Jul 24 18:17:59 user nova-compute[70375]:       <nova:ports>
Jul 24 18:17:59 user nova-compute[70375]:         <nova:port uuid="f9fd4b12-196b-48a3-bf06-d4259b1d147c">
Jul 24 18:17:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 18:17:59 user nova-compute[70375]:         </nova:port>
Jul 24 18:17:59 user nova-compute[70375]:       </nova:ports>
Jul 24 18:17:59 user nova-compute[70375]:     </nova:instance>
Jul 24 18:17:59 user nova-compute[70375]:   </metadata>
Jul 24 18:17:59 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:17:59 user nova-compute[70375]:     <system>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="serial">b40890a1-9404-4341-a82e-2d11818b20a7</entry>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="uuid">b40890a1-9404-4341-a82e-2d11818b20a7</entry>
Jul 24 18:17:59 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:17:59 user nova-compute[70375]:     </system>
Jul 24 18:17:59 user nova-compute[70375]:   </sysinfo>
Jul 24 18:17:59 user nova-compute[70375]:   <os>
Jul 24 18:17:59 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:17:59 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:17:59 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:17:59 user nova-compute[70375]:   </os>
Jul 24 18:17:59 user nova-compute[70375]:   <features>
Jul 24 18:17:59 user nova-compute[70375]:     <acpi/>
Jul 24 18:17:59 user nova-compute[70375]:     <apic/>
Jul 24 18:17:59 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:17:59 user nova-compute[70375]:   </features>
Jul 24 18:17:59 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:17:59 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:17:59 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:17:59 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:17:59 user nova-compute[70375]:   </clock>
Jul 24 18:17:59 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:17:59 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:17:59 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:17:59 user nova-compute[70375]:   </cpu>
Jul 24 18:17:59 user nova-compute[70375]:   <devices>
Jul 24 18:17:59 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:17:59 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:17:59 user nova-compute[70375]:       <source dev="/dev/sdc"/>
Jul 24 18:17:59 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:17:59 user nova-compute[70375]:       <serial>b144408c-394a-43e7-be7f-308c194d5d64</serial>
Jul 24 18:17:59 user nova-compute[70375]:     </disk>
Jul 24 18:17:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:17:59 user nova-compute[70375]:       <mac address="fa:16:3e:37:97:c6"/>
Jul 24 18:17:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:17:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:17:59 user nova-compute[70375]:       <target dev="tapf9fd4b12-19"/>
Jul 24 18:17:59 user nova-compute[70375]:     </interface>
Jul 24 18:17:59 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:17:59 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/b40890a1-9404-4341-a82e-2d11818b20a7/console.log" append="off"/>
Jul 24 18:17:59 user nova-compute[70375]:     </serial>
Jul 24 18:17:59 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:17:59 user nova-compute[70375]:     <video>
Jul 24 18:17:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:17:59 user nova-compute[70375]:     </video>
Jul 24 18:17:59 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:17:59 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:17:59 user nova-compute[70375]:     </rng>
Jul 24 18:17:59 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:17:59 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:17:59 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:17:59 user nova-compute[70375]:     </memballoon>
Jul 24 18:17:59 user nova-compute[70375]:   </devices>
Jul 24 18:17:59 user nova-compute[70375]: </domain>
Jul 24 18:17:59 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1417532518',display_name='tempest-TestVolumeBootPattern-server-1417532518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1417532518',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-8hwo5mz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:17:47Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=b40890a1-9404-4341-a82e-2d11818b20a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG os_vif [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fd4b12-19, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9fd4b12-19, col_values=(('external_ids', {'iface-id': 'f9fd4b12-196b-48a3-bf06-d4259b1d147c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:97:c6', 'vm-uuid': 'b40890a1-9404-4341-a82e-2d11818b20a7'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:17:59 user nova-compute[70375]: INFO os_vif [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19')
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:17:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] No VIF found with MAC fa:16:3e:37:97:c6, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] No waiting events found dispatching network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:00 user nova-compute[70375]: WARNING nova.compute.manager [req-a0ca26e8-9f2d-4c71-a316-d9b7e086ca05 req-c9899b55-cf15-428e-9098-cd766aadf97a service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received unexpected event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c for instance with vm_state building and task_state spawning.
Jul 24 18:18:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222682.6374714, b40890a1-9404-4341-a82e-2d11818b20a7 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] VM Resumed (Lifecycle Event)
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Instance spawned successfully.
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222682.6398304, b40890a1-9404-4341-a82e-2d11818b20a7 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] VM Started (Lifecycle Event)
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Took 4.89 seconds to spawn the instance on the hypervisor.
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:02 user nova-compute[70375]: INFO nova.compute.manager [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Took 15.98 seconds to build instance.
Jul 24 18:18:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b01119d7-b9f7-4ff7-a8e9-b4fd807ee64d tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.074s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] No waiting events found dispatching network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:02 user nova-compute[70375]: WARNING nova.compute.manager [req-6cc26cf0-9ce7-4b0d-a249-6edcd92b1508 req-97487bf2-4081-463f-bf87-0d545447cf94 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received unexpected event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c for instance with vm_state active and task_state None.
Jul 24 18:18:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:11 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222676.0932317, 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:18:11 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] VM Stopped (Lifecycle Event)
Jul 24 18:18:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-886d8a92-e6ac-4b71-a653-d06bbceccc96 None None] [instance: 90b9c8ee-0bd2-4f4f-a0b2-d625732c3dc2] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:18:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:38 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:18:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:18:45 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:18:47 user nova-compute[70375]: INFO nova.compute.claims [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Claim successful on node user
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:18:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.policy [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887e0d1db9494dcf94fcdc587babd25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8ea79ad686442ba582dbac9814ed3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:18:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Creating image(s)
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "/opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "/opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "/opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.168s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk 1073741824" returned: 0 in 0.049s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.148s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Successfully created port: 5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Cannot resize image /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'migration_context' on Instance uuid 9079d866-b2b5-41a1-a20a-38fb4e766eb8 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Ensure instance console log exists: /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Successfully updated port: 5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquired lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-changed-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.compute.manager [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Refreshing instance network info cache due to event network-changed-5fdace48-be61-4589-9990-ee629adbb6b4. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] Acquiring lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Updating instance_info_cache with network_info: [{"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Releasing lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Instance network_info: |[{"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] Acquired lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.neutron [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Refreshing network info cache for port 5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Start _get_guest_xml network_info=[{"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:18:49 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:18:49 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1814881777',display_name='tempest-VolumesActionsTest-instance-1814881777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1814881777',id=47,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-1nn0uj2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:18:48Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=9079d866-b2b5-41a1-a20a-38fb4e766eb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'pci_devices' on Instance uuid 9079d866-b2b5-41a1-a20a-38fb4e766eb8 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:18:49 user nova-compute[70375]:   <uuid>9079d866-b2b5-41a1-a20a-38fb4e766eb8</uuid>
Jul 24 18:18:49 user nova-compute[70375]:   <name>instance-0000002f</name>
Jul 24 18:18:49 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:18:49 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:18:49 user nova-compute[70375]:   <metadata>
Jul 24 18:18:49 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:18:49 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:name>tempest-VolumesActionsTest-instance-1814881777</nova:name>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:18:49</nova:creationTime>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:18:49 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:18:49 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:owner>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:user uuid="887e0d1db9494dcf94fcdc587babd25b">tempest-VolumesActionsTest-388853914-project-member</nova:user>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:project uuid="ee8ea79ad686442ba582dbac9814ed3b">tempest-VolumesActionsTest-388853914</nova:project>
Jul 24 18:18:49 user nova-compute[70375]:       </nova:owner>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:18:49 user nova-compute[70375]:       <nova:ports>
Jul 24 18:18:49 user nova-compute[70375]:         <nova:port uuid="5fdace48-be61-4589-9990-ee629adbb6b4">
Jul 24 18:18:49 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 18:18:49 user nova-compute[70375]:         </nova:port>
Jul 24 18:18:49 user nova-compute[70375]:       </nova:ports>
Jul 24 18:18:49 user nova-compute[70375]:     </nova:instance>
Jul 24 18:18:49 user nova-compute[70375]:   </metadata>
Jul 24 18:18:49 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:18:49 user nova-compute[70375]:     <system>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="serial">9079d866-b2b5-41a1-a20a-38fb4e766eb8</entry>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="uuid">9079d866-b2b5-41a1-a20a-38fb4e766eb8</entry>
Jul 24 18:18:49 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:18:49 user nova-compute[70375]:     </system>
Jul 24 18:18:49 user nova-compute[70375]:   </sysinfo>
Jul 24 18:18:49 user nova-compute[70375]:   <os>
Jul 24 18:18:49 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:18:49 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:18:49 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:18:49 user nova-compute[70375]:   </os>
Jul 24 18:18:49 user nova-compute[70375]:   <features>
Jul 24 18:18:49 user nova-compute[70375]:     <acpi/>
Jul 24 18:18:49 user nova-compute[70375]:     <apic/>
Jul 24 18:18:49 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:18:49 user nova-compute[70375]:   </features>
Jul 24 18:18:49 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:18:49 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:18:49 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:18:49 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:18:49 user nova-compute[70375]:   </clock>
Jul 24 18:18:49 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:18:49 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:18:49 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:18:49 user nova-compute[70375]:   </cpu>
Jul 24 18:18:49 user nova-compute[70375]:   <devices>
Jul 24 18:18:49 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:18:49 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:18:49 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk"/>
Jul 24 18:18:49 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:18:49 user nova-compute[70375]:     </disk>
Jul 24 18:18:49 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:18:49 user nova-compute[70375]:       <mac address="fa:16:3e:9b:9d:12"/>
Jul 24 18:18:49 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:18:49 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:18:49 user nova-compute[70375]:       <target dev="tap5fdace48-be"/>
Jul 24 18:18:49 user nova-compute[70375]:     </interface>
Jul 24 18:18:49 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:18:49 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/console.log" append="off"/>
Jul 24 18:18:49 user nova-compute[70375]:     </serial>
Jul 24 18:18:49 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:18:49 user nova-compute[70375]:     <video>
Jul 24 18:18:49 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:18:49 user nova-compute[70375]:     </video>
Jul 24 18:18:49 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:18:49 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:18:49 user nova-compute[70375]:     </rng>
Jul 24 18:18:49 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:18:49 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:18:49 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:18:49 user nova-compute[70375]:     </memballoon>
Jul 24 18:18:49 user nova-compute[70375]:   </devices>
Jul 24 18:18:49 user nova-compute[70375]: </domain>
Jul 24 18:18:49 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1814881777',display_name='tempest-VolumesActionsTest-instance-1814881777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1814881777',id=47,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-1nn0uj2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:18:48Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=9079d866-b2b5-41a1-a20a-38fb4e766eb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG os_vif [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fdace48-be, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fdace48-be, col_values=(('external_ids', {'iface-id': '5fdace48-be61-4589-9990-ee629adbb6b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:9d:12', 'vm-uuid': '9079d866-b2b5-41a1-a20a-38fb4e766eb8'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:49 user nova-compute[70375]: INFO os_vif [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be')
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:49 user nova-compute[70375]: INFO nova.compute.manager [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Detaching volume 2a6d7f61-7355-4468-b9ef-2626b3f2ed8f
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:18:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] No VIF found with MAC fa:16:3e:9b:9d:12, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:18:50 user nova-compute[70375]: INFO nova.virt.block_device [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Attempting to driver detach volume 2a6d7f61-7355-4468-b9ef-2626b3f2ed8f from mountpoint /dev/vdb
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Attempting to detach device vdb from instance c10a72e2-3387-47f7-938e-57f69b58c887 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:18:50 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:18:50 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:18:50 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:18:50 user nova-compute[70375]:   <serial>2a6d7f61-7355-4468-b9ef-2626b3f2ed8f</serial>
Jul 24 18:18:50 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:18:50 user nova-compute[70375]: </disk>
Jul 24 18:18:50 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:18:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdb from instance c10a72e2-3387-47f7-938e-57f69b58c887 from the persistent domain config.
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c10a72e2-3387-47f7-938e-57f69b58c887 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:18:50 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:18:50 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:18:50 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:18:50 user nova-compute[70375]:   <serial>2a6d7f61-7355-4468-b9ef-2626b3f2ed8f</serial>
Jul 24 18:18:50 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:18:50 user nova-compute[70375]: </disk>
Jul 24 18:18:50 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.network.neutron [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Updated VIF entry in instance network info cache for port 5fdace48-be61-4589-9990-ee629adbb6b4. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.network.neutron [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Updating instance_info_cache with network_info: [{"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-9d39cd0e-fde3-4c22-9b83-29ed853bb362 req-a6e56d2b-9259-4744-b528-7f65ed9b06f9 service nova] Releasing lock "refresh_cache-9079d866-b2b5-41a1-a20a-38fb4e766eb8" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690222730.5675132, c10a72e2-3387-47f7-938e-57f69b58c887 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:18:50 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdb from instance c10a72e2-3387-47f7-938e-57f69b58c887 from the live domain config.
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMuFTzDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:18:50 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b0aa5-fea9-4766-8ce5-be1c3c7dfbf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:18:50 user nova-compute[70375]: No targets found.
Jul 24 18:18:50 user nova-compute[70375]: iSNS:
Jul 24 18:18:50 user nova-compute[70375]: No targets found.
Jul 24 18:18:50 user nova-compute[70375]: STATIC:
Jul 24 18:18:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f
Jul 24 18:18:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:18:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:18:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64
Jul 24 18:18:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:18:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:18:50 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:18:50 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:18:50 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:18:50 user nova-compute[70375]: FIRMWARE:
Jul 24 18:18:50 user nova-compute[70375]: No targets found.
Jul 24 18:18:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:18:50 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:18:50 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ca564-87e1-40f8-8902-10701893363b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18de9d7-2c88-4d7e-909a-b3bb58dcaef7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:18:50 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:18:50 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:18:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:18:50 user nova-compute[70375]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f (non-flash)
Jul 24 18:18:50 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:18:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6502b77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[20418790-fef4-435e-b57d-e609a4724aa7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c984667-0c72-4b26-92fc-6dd5344b9aa0]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef94ae3-5298-438b-936f-40b1600b114e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbee1f6-23f8-4240-8aa8-7dbda24c6757]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd462b1-1ee6-4218-bde9-fbe073810da1]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3e2128-d654-4d92-a5c4-2bf6ffad2f2e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260]
Jul 24 18:18:50 user nova-compute[70375]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f, portal: 172.16.0.220,3260] successful.
Jul 24 18:18:50 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6d7f61-7355-4468-b9ef-2626b3f2ed8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af1b014-db8b-4186-ba96-5c904d3a0518]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== disconnect_volume: return (320ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:18:50 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] No waiting events found dispatching network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:51 user nova-compute[70375]: WARNING nova.compute.manager [req-fd707e48-37e9-4b07-a4fa-44401fd4b7d6 req-29af5d4a-219f-4404-9285-4b73a7c7c042 service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received unexpected event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 for instance with vm_state building and task_state spawning.
Jul 24 18:18:51 user nova-compute[70375]: DEBUG nova.objects.instance [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:18:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-501eb9d5-8e1c-4e38-a589-37ed216805ff tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.844s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70375) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance destroyed successfully.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f4b9e6c5-d0bc-40cd-a480-bce1e8ab0adc tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.827s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222733.6672106, 9079d866-b2b5-41a1-a20a-38fb4e766eb8 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] VM Resumed (Lifecycle Event)
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Instance spawned successfully.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222733.6683288, 9079d866-b2b5-41a1-a20a-38fb4e766eb8 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] VM Started (Lifecycle Event)
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] No waiting events found dispatching network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:53 user nova-compute[70375]: WARNING nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received unexpected event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 for instance with vm_state building and task_state spawning.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:53 user nova-compute[70375]: WARNING nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:18:53 user nova-compute[70375]: WARNING nova.compute.manager [req-3b2d32d2-78f4-4dd9-9f95-b6fc52c9a777 req-a1c32a31-8d9d-4c2e-aa19-4b89ad24e69a service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state None.
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Took 6.19 seconds to spawn the instance on the hypervisor.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:18:53 user nova-compute[70375]: INFO nova.compute.manager [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Took 6.73 seconds to build instance.
Jul 24 18:18:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-fc2e7ffa-69b9-4d24-b06c-83655bbea687 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.822s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:18:54 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:18:55 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:18:55 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=24.196086883544922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 715b366b-3deb-4fa0-81db-b2ac63daea7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance b40890a1-9404-4341-a82e-2d11818b20a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9079d866-b2b5-41a1-a20a-38fb4e766eb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:18:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:18:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:18:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:18:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:08 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222733.0079222, c10a72e2-3387-47f7-938e-57f69b58c887 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:19:08 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Stopped (Lifecycle Event)
Jul 24 18:19:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9aafad9a-2f7e-4d3f-a881-e10594f3b347 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:19:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9aafad9a-2f7e-4d3f-a881-e10594f3b347 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:19:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:14 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:19:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:20 user nova-compute[70375]: INFO nova.compute.manager [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Unshelving
Jul 24 18:19:20 user nova-compute[70375]: INFO nova.virt.block_device [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Booting with volume 410825c3-9344-45e9-93aa-5ca5c2d308a9 at /dev/vdc
Jul 24 18:19:20 user nova-compute[70375]: DEBUG os_brick.utils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0166ad-1175-40ad-865f-64f4649f4d86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d36ad8-89a9-4968-bda8-d62e7edbd8ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:20 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6df1b-b7bb-4c5c-aedc-99ff65af9eb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a203265-3fac-467c-9137-2b8d62331766]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:19:21 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:19:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a551d-e939-4b12-a97c-126170a19d32]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG os_brick.utils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating existing volume attachment record: 08aedf83-5bac-41b1-83e8-0be12607cce0 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:19:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_requests' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'numa_topology' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:19:27 user nova-compute[70375]: INFO nova.compute.claims [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Claim successful on node user
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:19:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:19:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:19:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:19:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:28 user nova-compute[70375]: INFO nova.network.neutron [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing instance network info cache due to event network-changed-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] Acquiring lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:19:29 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Creating image(s)
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] Acquired lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG nova.network.neutron [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Refreshing network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "afa96518d5e218b137798bf83b7662719b913382" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "afa96518d5e218b137798bf83b7662719b913382" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.part --force-share --output=json" returned: 0 in 0.145s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG nova.virt.images [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] 7686df83-4f40-432b-abaf-656113baef83 was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:19:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.part /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG nova.network.neutron [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updated VIF entry in instance network info cache for port 47a7a498-24cf-4fe5-b363-2a7d7bf3ceee. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG nova.network.neutron [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-023bfacf-4439-4e6d-83c3-dfd10b289660 req-a53e2306-7dea-4173-9587-946f219ea636 service nova] Releasing lock "refresh_cache-a0176d15-d012-4d0f-8374-73926407c0af" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.part /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.converted" returned: 0 in 0.466s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "afa96518d5e218b137798bf83b7662719b913382" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.821s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "afa96518d5e218b137798bf83b7662719b913382" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "afa96518d5e218b137798bf83b7662719b913382" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382,backing_fmt=raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382,backing_fmt=raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk 1073741824" returned: 0 in 0.049s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "afa96518d5e218b137798bf83b7662719b913382" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'migration_context' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:31 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Rebasing disk image.
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f -F raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f -F raw /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk" returned: 0 in 1.975s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Ensure instance console log exists: /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start _get_guest_xml network_info=[{"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='67b5d675a1121a79d34d003230c38e3c',container_format='bare',created_at=2023-07-24T18:17:29Z,direct_url=<?>,disk_format='qcow2',id=7686df83-4f40-432b-abaf-656113baef83,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-611132264-shelved',owner='0898cf4400f1426493ed139b25fb7d56',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T18:17:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '08aedf83-5bac-41b1-83e8-0be12607cce0', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUALlNXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a0176d15-d012-4d0f-8374-73926407c0af', 'attached_at': '', 'detached_at': '', 'volume_id': '410825c3-9344-45e9-93aa-5ca5c2d308a9', 'serial': '410825c3-9344-45e9-93aa-5ca5c2d308a9'}, 'mount_device': '/dev/vdc', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:19:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:19:33 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='67b5d675a1121a79d34d003230c38e3c',container_format='bare',created_at=2023-07-24T18:17:29Z,direct_url=<?>,disk_format='qcow2',id=7686df83-4f40-432b-abaf-656113baef83,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-611132264-shelved',owner='0898cf4400f1426493ed139b25fb7d56',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T18:17:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:19:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUALlNXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:19:34 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:19:34 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:19:34 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b265e3b9-56a1-4a22-9d7c-6b6d8f375d96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:19:34 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[493b73cb-8bf6-4250-bd1f-a169517bf297]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9] added
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[351566ed-6985-4ba1-a3b8-61d2a9ef76d3]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[542db90d-2133-405c-b364-12997efe8724]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUALlNXQ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUALlNXQ" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a30f9b-a555-47a2-b72f-f8feec18f5e9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUALlNXQ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780b43b-32b4-445f-b3f0-e260b8e73b9c]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6764775c-68e5-46c4-9b46-4b2396d43302]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e04da5-e8b6-451f-8037-6d8b14361ff5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260]
Jul 24 18:19:34 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260] successful.
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a471f456-ad05-4eaf-8c4c-0c164e3a5c91]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[01588dc2-93cb-4fe6-9a1a-cde5b538a16d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:19:34 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591d361-157b-42ad-8422-b1f32a30a05c]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:19:34 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUALlNXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23736383662616261', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736383662616261', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='7686df83-4f40-432b-abaf-656113baef83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-547467386',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:17:32.857286',shelved_host='user',shelved_image_id='7686df83-4f40-432b-abaf-656113baef83'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_devices' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:19:35 user nova-compute[70375]:   <uuid>a0176d15-d012-4d0f-8374-73926407c0af</uuid>
Jul 24 18:19:35 user nova-compute[70375]:   <name>instance-0000002b</name>
Jul 24 18:19:35 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:19:35 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:19:35 user nova-compute[70375]:   <metadata>
Jul 24 18:19:35 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:19:35 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-611132264</nova:name>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:19:33</nova:creationTime>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:19:35 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:19:35 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:owner>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:user uuid="65334a0d26ca4007b4214f0eaf69bb17">tempest-AttachVolumeShelveTestJSON-485068176-project-member</nova:user>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:project uuid="0898cf4400f1426493ed139b25fb7d56">tempest-AttachVolumeShelveTestJSON-485068176</nova:project>
Jul 24 18:19:35 user nova-compute[70375]:       </nova:owner>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:root type="image" uuid="7686df83-4f40-432b-abaf-656113baef83"/>
Jul 24 18:19:35 user nova-compute[70375]:       <nova:ports>
Jul 24 18:19:35 user nova-compute[70375]:         <nova:port uuid="47a7a498-24cf-4fe5-b363-2a7d7bf3ceee">
Jul 24 18:19:35 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 18:19:35 user nova-compute[70375]:         </nova:port>
Jul 24 18:19:35 user nova-compute[70375]:       </nova:ports>
Jul 24 18:19:35 user nova-compute[70375]:     </nova:instance>
Jul 24 18:19:35 user nova-compute[70375]:   </metadata>
Jul 24 18:19:35 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:19:35 user nova-compute[70375]:     <system>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="serial">a0176d15-d012-4d0f-8374-73926407c0af</entry>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="uuid">a0176d15-d012-4d0f-8374-73926407c0af</entry>
Jul 24 18:19:35 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:19:35 user nova-compute[70375]:     </system>
Jul 24 18:19:35 user nova-compute[70375]:   </sysinfo>
Jul 24 18:19:35 user nova-compute[70375]:   <os>
Jul 24 18:19:35 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:19:35 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:19:35 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:19:35 user nova-compute[70375]:   </os>
Jul 24 18:19:35 user nova-compute[70375]:   <features>
Jul 24 18:19:35 user nova-compute[70375]:     <acpi/>
Jul 24 18:19:35 user nova-compute[70375]:     <apic/>
Jul 24 18:19:35 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:19:35 user nova-compute[70375]:   </features>
Jul 24 18:19:35 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:19:35 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:19:35 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:19:35 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:19:35 user nova-compute[70375]:   </clock>
Jul 24 18:19:35 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:19:35 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:19:35 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:19:35 user nova-compute[70375]:   </cpu>
Jul 24 18:19:35 user nova-compute[70375]:   <devices>
Jul 24 18:19:35 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:19:35 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:19:35 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk"/>
Jul 24 18:19:35 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:19:35 user nova-compute[70375]:     </disk>
Jul 24 18:19:35 user nova-compute[70375]:     <disk type="block" device="disk">
Jul 24 18:19:35 user nova-compute[70375]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:19:35 user nova-compute[70375]:       <source dev="/dev/sdb"/>
Jul 24 18:19:35 user nova-compute[70375]:       <target dev="vdc" bus="virtio"/>
Jul 24 18:19:35 user nova-compute[70375]:       <serial>410825c3-9344-45e9-93aa-5ca5c2d308a9</serial>
Jul 24 18:19:35 user nova-compute[70375]:     </disk>
Jul 24 18:19:35 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:19:35 user nova-compute[70375]:       <mac address="fa:16:3e:94:1a:d5"/>
Jul 24 18:19:35 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:19:35 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:19:35 user nova-compute[70375]:       <target dev="tap47a7a498-24"/>
Jul 24 18:19:35 user nova-compute[70375]:     </interface>
Jul 24 18:19:35 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:19:35 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/console.log" append="off"/>
Jul 24 18:19:35 user nova-compute[70375]:     </serial>
Jul 24 18:19:35 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:19:35 user nova-compute[70375]:     <video>
Jul 24 18:19:35 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:19:35 user nova-compute[70375]:     </video>
Jul 24 18:19:35 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:19:35 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:19:35 user nova-compute[70375]:     </rng>
Jul 24 18:19:35 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:19:35 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:19:35 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:19:35 user nova-compute[70375]:     </memballoon>
Jul 24 18:19:35 user nova-compute[70375]:   </devices>
Jul 24 18:19:35 user nova-compute[70375]: </domain>
Jul 24 18:19:35 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='7686df83-4f40-432b-abaf-656113baef83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-547467386',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:17:32.857286',shelved_host='user',shelved_image_id='7686df83-4f40-432b-abaf-656113baef83'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG os_vif [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47a7a498-24, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47a7a498-24, col_values=(('external_ids', {'iface-id': '47a7a498-24cf-4fe5-b363-2a7d7bf3ceee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:1a:d5', 'vm-uuid': 'a0176d15-d012-4d0f-8374-73926407c0af'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:35 user nova-compute[70375]: INFO os_vif [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24')
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:19:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No VIF found with MAC fa:16:3e:94:1a:d5, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:19:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:19:37 user nova-compute[70375]: WARNING nova.compute.manager [req-4420bd4b-86f4-43c8-a31f-711f0d14168d req-63052fa3-50b5-48ae-866f-5731da295a73 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 18:19:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing instance network info cache due to event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] Acquiring lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] Acquired lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.network.neutron [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222778.7638903, a0176d15-d012-4d0f-8374-73926407c0af => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:19:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Resumed (Lifecycle Event)
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:19:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance spawned successfully.
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:19:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222778.7653592, a0176d15-d012-4d0f-8374-73926407c0af => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:19:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Started (Lifecycle Event)
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:19:38 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:19:38 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4fca5185-81d5-411a-8486-541fe896d679 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.304s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:19:39 user nova-compute[70375]: WARNING nova.compute.manager [req-07fbef96-2aef-4ec0-ae61-55b8de855f67 req-6c970954-bf7e-4b6b-af1e-526a771f9f36 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state active and task_state None.
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updated VIF entry in instance network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating instance_info_cache with network_info: [{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3189d439-3959-47d1-b5ea-b2d7b8b29415 req-8b9f1c1f-0e9b-4dfe-81b4-29298b070501 service nova] Releasing lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:39 user nova-compute[70375]: INFO nova.compute.manager [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Terminating instance
Jul 24 18:19:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Instance destroyed successfully.
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid b40890a1-9404-4341-a82e-2d11818b20a7 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1417532518',display_name='tempest-TestVolumeBootPattern-server-1417532518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1417532518',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:18:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-8hwo5mz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:18:03Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=b40890a1-9404-4341-a82e-2d11818b20a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_vif [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fd4b12-19, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:40 user nova-compute[70375]: INFO os_vif [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:97:c6,bridge_name='br-int',has_traffic_filtering=True,id=f9fd4b12-196b-48a3-bf06-d4259b1d147c,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fd4b12-19')
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIdqpVLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:19:40 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[57981afc-575e-459f-b05e-3c6e5a31cd29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:19:40 user nova-compute[70375]: No targets found.
Jul 24 18:19:40 user nova-compute[70375]: iSNS:
Jul 24 18:19:40 user nova-compute[70375]: No targets found.
Jul 24 18:19:40 user nova-compute[70375]: STATIC:
Jul 24 18:19:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9
Jul 24 18:19:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:19:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:19:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64
Jul 24 18:19:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:19:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:19:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:19:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:19:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:19:40 user nova-compute[70375]: FIRMWARE:
Jul 24 18:19:40 user nova-compute[70375]: No targets found.
Jul 24 18:19:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:19:40 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:19:40 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba034c-efe4-44fe-90f9-b71aaf298a9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bdb450-2e79-4651-81e1-e885e74f4ad9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:19:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe650190040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4156e5f-1159-4106-ac39-4b8dce495000]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f729abb-7e9e-470c-9781-2d6a47b32cee]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[58575db2-9a2b-433b-b401-83794300f919]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c634d3-9599-475a-b677-d1a2a08e44cc]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4387d83-3b00-4a67-9fb9-2b8c16977585]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing instance network info cache due to event network-changed-f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Acquiring lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Acquired lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.network.neutron [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Refreshing network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89d98a-93c2-4754-9c79-37dd34e16651]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260]
Jul 24 18:19:40 user nova-compute[70375]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64, portal: 172.16.0.220,3260] successful.
Jul 24 18:19:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b144408c-394a-43e7-be7f-308c194d5d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d61ed-447b-49c2-b4d2-ea8ca7a771b6]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (347ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:19:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Deleting instance files /opt/stack/data/nova/instances/b40890a1-9404-4341-a82e-2d11818b20a7_del
Jul 24 18:19:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Deletion of /opt/stack/data/nova/instances/b40890a1-9404-4341-a82e-2d11818b20a7_del complete
Jul 24 18:19:40 user nova-compute[70375]: INFO nova.compute.manager [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 24 18:19:40 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:19:40 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.network.neutron [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updated VIF entry in instance network info cache for port f9fd4b12-196b-48a3-bf06-d4259b1d147c. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.network.neutron [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating instance_info_cache with network_info: [{"id": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "address": "fa:16:3e:37:97:c6", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fd4b12-19", "ovs_interfaceid": "f9fd4b12-196b-48a3-bf06-d4259b1d147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Releasing lock "refresh_cache-b40890a1-9404-4341-a82e-2d11818b20a7" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-unplugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] No waiting events found dispatching network-vif-unplugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-unplugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Acquiring lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] Lock "b40890a1-9404-4341-a82e-2d11818b20a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] No waiting events found dispatching network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:19:41 user nova-compute[70375]: WARNING nova.compute.manager [req-a1bfb648-7a1a-4246-875a-656162f85ce4 req-d4f671a7-1328-4cf0-aa46-ddd70467f241 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received unexpected event network-vif-plugged-f9fd4b12-196b-48a3-bf06-d4259b1d147c for instance with vm_state active and task_state deleting.
Jul 24 18:19:41 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:41 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Took 0.47 seconds to deallocate network for instance.
Jul 24 18:19:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:42 user nova-compute[70375]: INFO nova.compute.manager [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Took 0.79 seconds to detach 1 volumes for instance.
Jul 24 18:19:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:42 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:19:42 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:19:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:42 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance b40890a1-9404-4341-a82e-2d11818b20a7
Jul 24 18:19:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b8878957-013b-42a0-a2c6-dbe3b41817eb tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "b40890a1-9404-4341-a82e-2d11818b20a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-45914282-3741-4788-bc0f-c0fa77d5c4ab req-05c427d6-f2e4-458e-82fc-e448a98eced4 service nova] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Received event network-vif-deleted-f9fd4b12-196b-48a3-bf06-d4259b1d147c {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:19:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:19:46 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:19:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:19:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:51 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:19:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222780.4352825, b40890a1-9404-4341-a82e-2d11818b20a7 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:19:55 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] VM Stopped (Lifecycle Event)
Jul 24 18:19:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-bd248208-2736-4723-b57d-0458ab1d708c None None] [instance: b40890a1-9404-4341-a82e-2d11818b20a7] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:19:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:19:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=24.133861541748047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 715b366b-3deb-4fa0-81db-b2ac63daea7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 9079d866-b2b5-41a1-a20a-38fb4e766eb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a0176d15-d012-4d0f-8374-73926407c0af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:19:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:20:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:37 user nova-compute[70375]: INFO nova.compute.manager [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Terminating instance
Jul 24 18:20:37 user nova-compute[70375]: DEBUG nova.compute.manager [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:20:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-unplugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] No waiting events found dispatching network-vif-unplugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.compute.manager [req-4c425172-72b0-475b-90ea-a17bab19877e req-d97273dc-1889-4d36-943e-ade170111d4c service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-unplugged-5fdace48-be61-4589-9990-ee629adbb6b4 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Instance destroyed successfully.
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.objects.instance [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lazy-loading 'resources' on Instance uuid 9079d866-b2b5-41a1-a20a-38fb4e766eb8 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1814881777',display_name='tempest-VolumesActionsTest-instance-1814881777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1814881777',id=47,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee8ea79ad686442ba582dbac9814ed3b',ramdisk_id='',reservation_id='r-1nn0uj2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-388853914',owner_user_name='tempest-VolumesActionsTest-388853914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:18:54Z,user_data=None,user_id='887e0d1db9494dcf94fcdc587babd25b',uuid=9079d866-b2b5-41a1-a20a-38fb4e766eb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converting VIF {"id": "5fdace48-be61-4589-9990-ee629adbb6b4", "address": "fa:16:3e:9b:9d:12", "network": {"id": "3b760cb2-a031-4f9e-badc-99a530e1398f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-330356499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8ea79ad686442ba582dbac9814ed3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdace48-be", "ovs_interfaceid": "5fdace48-be61-4589-9990-ee629adbb6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG os_vif [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fdace48-be, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:38 user nova-compute[70375]: INFO os_vif [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9d:12,bridge_name='br-int',has_traffic_filtering=True,id=5fdace48-be61-4589-9990-ee629adbb6b4,network=Network(3b760cb2-a031-4f9e-badc-99a530e1398f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdace48-be')
Jul 24 18:20:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Deleting instance files /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8_del
Jul 24 18:20:38 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Deletion of /opt/stack/data/nova/instances/9079d866-b2b5-41a1-a20a-38fb4e766eb8_del complete
Jul 24 18:20:38 user nova-compute[70375]: INFO nova.compute.manager [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 24 18:20:38 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:20:38 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:20:39 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Took 0.46 seconds to deallocate network for instance.
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing instance network info cache due to event network-changed-ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] Acquiring lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] Acquired lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Refreshing network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:39 user nova-compute[70375]: INFO nova.compute.manager [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Terminating instance
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:39 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Deleted allocations for instance 9079d866-b2b5-41a1-a20a-38fb4e766eb8
Jul 24 18:20:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-a6c59369-6e57-423b-9e63-a86bb9a91e03 tempest-VolumesActionsTest-388853914 tempest-VolumesActionsTest-388853914-project-member] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.767s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-unplugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] No waiting events found dispatching network-vif-unplugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.compute.manager [req-dbb97df0-bde1-4c76-a4c6-1512eff0cc36 req-cde96d04-e3f4-4591-be1f-aa534411d0f0 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-unplugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updated VIF entry in instance network info cache for port ee0c2022-83af-4d97-aea8-4e2c51264d24. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG nova.network.neutron [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [{"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:20:39 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7d852663-ad35-4e01-8102-4843db353452 req-a3677d55-67d1-414a-a838-ab2b21af7e42 service nova] Releasing lock "refresh_cache-715b366b-3deb-4fa0-81db-b2ac63daea7e" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:20:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Instance destroyed successfully.
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lazy-loading 'resources' on Instance uuid 715b366b-3deb-4fa0-81db-b2ac63daea7e {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163632340',display_name='tempest-TestVolumeBootPattern-server-163632340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163632340',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdunW+Tadksi4MHpfzccWCauPBr1acTdyCIIGBlq6AvgDYCkPx+J6bWXx17ASRq0rvKyOesnm1VaWCmVFFtfulGXoLUJwPVMH3ul2pip1oRQSypiLvVQIt5GoJNwMpGBg==',key_name='tempest-TestVolumeBootPattern-1793817380',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31b27038d1342519b6660f16785bbaa',ramdisk_id='',reservation_id='r-r7d4t16y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-728863810',owner_user_name='tempest-TestVolumeBootPattern-728863810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:15:56Z,user_data=None,user_id='73db0166ab6848748b6680624f570ead',uuid=715b366b-3deb-4fa0-81db-b2ac63daea7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converting VIF {"id": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "address": "fa:16:3e:f2:43:1e", "network": {"id": "ea8eecb2-89db-4a49-903e-66e98c2f6706", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1241514858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31b27038d1342519b6660f16785bbaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0c2022-83", "ovs_interfaceid": "ee0c2022-83af-4d97-aea8-4e2c51264d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_vif [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0c2022-83, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:40 user nova-compute[70375]: INFO os_vif [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee0c2022-83af-4d97-aea8-4e2c51264d24,network=Network(ea8eecb2-89db-4a49-903e-66e98c2f6706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0c2022-83')
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIyrBcWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:20:40 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[42436741-6b7f-43c3-a6f9-f60c341c3cd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:20:40 user nova-compute[70375]: No targets found.
Jul 24 18:20:40 user nova-compute[70375]: iSNS:
Jul 24 18:20:40 user nova-compute[70375]: No targets found.
Jul 24 18:20:40 user nova-compute[70375]: STATIC:
Jul 24 18:20:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9
Jul 24 18:20:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:20:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:20:40 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298
Jul 24 18:20:40 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:20:40 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:20:40 user nova-compute[70375]: FIRMWARE:
Jul 24 18:20:40 user nova-compute[70375]: No targets found.
Jul 24 18:20:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:20:40 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:20:40 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0771b00-d2af-48d4-8930-b9d2c108a811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] Acquiring lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] Lock "9079d866-b2b5-41a1-a20a-38fb4e766eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] No waiting events found dispatching network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:40 user nova-compute[70375]: WARNING nova.compute.manager [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received unexpected event network-vif-plugged-5fdace48-be61-4589-9990-ee629adbb6b4 for instance with vm_state deleted and task_state None.
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.compute.manager [req-cac23c8a-7bf7-4227-b8f9-43c9bd18c23d req-172bfb39-45e5-4495-a32b-b9667c15a6eb service nova] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Received event network-vif-deleted-5fdace48-be61-4589-9990-ee629adbb6b4 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47d8cf-09c9-463b-a198-8eea254acc22]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:20:40 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:20:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 (non-flash)
Jul 24 18:20:40 user nova-compute[70375]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:20:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe63032bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298'): ({'sdd'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Removing single pathed devices sdd {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43ee56c-71b2-40ca-bba5-7aac25891a11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c1b620-233c-4220-9acf-7c4de071167b]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Flushing IO for device /dev/sdd {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e423ef-0df9-4fe0-9d8a-af66e370cc92]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f844a-475b-483a-95db-6ef55bdf19f3]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] SCSI volumes sdd have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130326430653430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_37804e02', '/dev/disk/by-id/scsi-1SCST_BIO37804e02-102d0e40ec094ffc') {{(pid=81399) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 18:20:40 user nova-compute[70375]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23130326430653430
Jul 24 18:20:40 user nova-compute[70375]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_37804e02
Jul 24 18:20:40 user nova-compute[70375]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO37804e02-102d0e40ec094ffc
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0827a577-1a63-4982-aae0-6657c6c3b6dc]: (4, None) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb99e8-7549-4a76-9ab0-61d7b51ff61a]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c0d31-2f32-4671-9d70-c79ffe4c3732]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260]
Jul 24 18:20:40 user nova-compute[70375]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298, portal: 172.16.0.220,3260] successful.
Jul 24 18:20:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e031d59-f636-40fa-8ebd-74ab04beb298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f2ded4-1a79-4c79-b748-f88cec01865d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] <== disconnect_volume: return (322ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:20:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Deleting instance files /opt/stack/data/nova/instances/715b366b-3deb-4fa0-81db-b2ac63daea7e_del
Jul 24 18:20:40 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Deletion of /opt/stack/data/nova/instances/715b366b-3deb-4fa0-81db-b2ac63daea7e_del complete
Jul 24 18:20:40 user nova-compute[70375]: INFO nova.compute.manager [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 24 18:20:40 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:20:40 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:20:41 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:20:41 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Took 0.90 seconds to deallocate network for instance.
Jul 24 18:20:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] Acquiring lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] No waiting events found dispatching network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:42 user nova-compute[70375]: WARNING nova.compute.manager [req-6825ef8e-f1b4-48b8-aa6b-5938b10342e0 req-163747c4-97d9-40c8-a3df-3be280d9fbee service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received unexpected event network-vif-plugged-ee0c2022-83af-4d97-aea8-4e2c51264d24 for instance with vm_state active and task_state deleting.
Jul 24 18:20:42 user nova-compute[70375]: INFO nova.compute.manager [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Took 0.73 seconds to detach 1 volumes for instance.
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG nova.compute.manager [req-025df3f4-41e5-4a00-a4ce-1163413ec26b req-9d146dc3-5c5a-4e27-b5e6-3d8484d127aa service nova] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Received event network-vif-deleted-ee0c2022-83af-4d97-aea8-4e2c51264d24 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:42 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Deleted allocations for instance 715b366b-3deb-4fa0-81db-b2ac63daea7e
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8d00de8b-2f95-4ae0-88f8-9a2918935787 tempest-TestVolumeBootPattern-728863810 tempest-TestVolumeBootPattern-728863810-project-member] Lock "715b366b-3deb-4fa0-81db-b2ac63daea7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:42 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'info_cache' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:20:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance destroyed successfully.
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'resources' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG os_vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93758659-46, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:20:43 user nova-compute[70375]: INFO os_vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start _get_guest_xml network_info=[{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:20:43 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'numa_topology' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:44 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:20:44 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'vcpu_model' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'pci_devices' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:20:44 user nova-compute[70375]:   <uuid>c10a72e2-3387-47f7-938e-57f69b58c887</uuid>
Jul 24 18:20:44 user nova-compute[70375]:   <name>instance-0000002a</name>
Jul 24 18:20:44 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:20:44 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:20:44 user nova-compute[70375]:   <metadata>
Jul 24 18:20:44 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:20:44 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeTestJSON-server-1173996728</nova:name>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:20:44</nova:creationTime>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:20:44 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:20:44 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:owner>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:user uuid="e91fc2ae6a3e4ccaa35a33dc589bcb63">tempest-AttachVolumeTestJSON-67425413-project-member</nova:user>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:project uuid="49c98e21a63a49a5817d6bf54d18dcd1">tempest-AttachVolumeTestJSON-67425413</nova:project>
Jul 24 18:20:44 user nova-compute[70375]:       </nova:owner>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:20:44 user nova-compute[70375]:       <nova:ports>
Jul 24 18:20:44 user nova-compute[70375]:         <nova:port uuid="93758659-4637-43ef-b475-16dd6fc2ffb3">
Jul 24 18:20:44 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 18:20:44 user nova-compute[70375]:         </nova:port>
Jul 24 18:20:44 user nova-compute[70375]:       </nova:ports>
Jul 24 18:20:44 user nova-compute[70375]:     </nova:instance>
Jul 24 18:20:44 user nova-compute[70375]:   </metadata>
Jul 24 18:20:44 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:20:44 user nova-compute[70375]:     <system>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="serial">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="uuid">c10a72e2-3387-47f7-938e-57f69b58c887</entry>
Jul 24 18:20:44 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:20:44 user nova-compute[70375]:     </system>
Jul 24 18:20:44 user nova-compute[70375]:   </sysinfo>
Jul 24 18:20:44 user nova-compute[70375]:   <os>
Jul 24 18:20:44 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:20:44 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:20:44 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:20:44 user nova-compute[70375]:   </os>
Jul 24 18:20:44 user nova-compute[70375]:   <features>
Jul 24 18:20:44 user nova-compute[70375]:     <acpi/>
Jul 24 18:20:44 user nova-compute[70375]:     <apic/>
Jul 24 18:20:44 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:20:44 user nova-compute[70375]:   </features>
Jul 24 18:20:44 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:20:44 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:20:44 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:20:44 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:20:44 user nova-compute[70375]:   </clock>
Jul 24 18:20:44 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:20:44 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:20:44 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:20:44 user nova-compute[70375]:   </cpu>
Jul 24 18:20:44 user nova-compute[70375]:   <devices>
Jul 24 18:20:44 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:20:44 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:20:44 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk"/>
Jul 24 18:20:44 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:20:44 user nova-compute[70375]:     </disk>
Jul 24 18:20:44 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:20:44 user nova-compute[70375]:       <mac address="fa:16:3e:cc:6a:95"/>
Jul 24 18:20:44 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:20:44 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:20:44 user nova-compute[70375]:       <target dev="tap93758659-46"/>
Jul 24 18:20:44 user nova-compute[70375]:     </interface>
Jul 24 18:20:44 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:20:44 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/console.log" append="off"/>
Jul 24 18:20:44 user nova-compute[70375]:     </serial>
Jul 24 18:20:44 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:20:44 user nova-compute[70375]:     <video>
Jul 24 18:20:44 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:20:44 user nova-compute[70375]:     </video>
Jul 24 18:20:44 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:20:44 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:20:44 user nova-compute[70375]:     </rng>
Jul 24 18:20:44 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:20:44 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:20:44 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:20:44 user nova-compute[70375]:     </memballoon>
Jul 24 18:20:44 user nova-compute[70375]:   </devices>
Jul 24 18:20:44 user nova-compute[70375]: </domain>
Jul 24 18:20:44 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'trusted_certs' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Cannot resize image /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'migration_context' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG os_vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93758659-46, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93758659-46, col_values=(('external_ids', {'iface-id': '93758659-4637-43ef-b475-16dd6fc2ffb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6a:95', 'vm-uuid': 'c10a72e2-3387-47f7-938e-57f69b58c887'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:20:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:44 user nova-compute[70375]: INFO os_vif [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:46 user nova-compute[70375]: WARNING nova.compute.manager [req-a57263ef-74c6-4637-b930-4a26d33458d8 req-754418e2-1ef3-4635-b40f-ec3d22015b1d service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state stopped and task_state powering-on.
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:20:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:20:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222848.2907906, c10a72e2-3387-47f7-938e-57f69b58c887 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:20:48 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Resumed (Lifecycle Event)
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:20:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance rebooted successfully.
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-53906573-dcc7-45ca-af92-4f9b662355b6 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:20:48 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222848.292338, c10a72e2-3387-47f7-938e-57f69b58c887 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:20:48 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Started (Lifecycle Event)
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:20:48 user nova-compute[70375]: WARNING nova.compute.manager [req-b7fb7271-afed-4801-9b24-d944d7a09eec req-c625c2f5-2abd-4217-a1b5-f9c474f281a2 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state active and task_state None.
Jul 24 18:20:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:20:53 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222838.6712632, 9079d866-b2b5-41a1-a20a-38fb4e766eb8 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:20:53 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] VM Stopped (Lifecycle Event)
Jul 24 18:20:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-c7f23c93-2d95-4301-83e1-fcf4570a73b2 None None] [instance: 9079d866-b2b5-41a1-a20a-38fb4e766eb8] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:20:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222840.2653334, 715b366b-3deb-4fa0-81db-b2ac63daea7e => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:20:55 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] VM Stopped (Lifecycle Event)
Jul 24 18:20:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1ac08145-889c-4634-aae7-2a4a7d435c19 None None] [instance: 715b366b-3deb-4fa0-81db-b2ac63daea7e] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:20:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70375) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 18:20:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:20:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=24.159820556640625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a0176d15-d012-4d0f-8374-73926407c0af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:20:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:20:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:21:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:21:11 user nova-compute[70375]: INFO nova.compute.manager [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Detaching volume 410825c3-9344-45e9-93aa-5ca5c2d308a9
Jul 24 18:21:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:11 user nova-compute[70375]: INFO nova.virt.block_device [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Attempting to driver detach volume 410825c3-9344-45e9-93aa-5ca5c2d308a9 from mountpoint /dev/vdc
Jul 24 18:21:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Attempting to detach device vdc from instance a0176d15-d012-4d0f-8374-73926407c0af from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:21:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:21:11 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:21:11 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:21:11 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:21:11 user nova-compute[70375]:   <serial>410825c3-9344-45e9-93aa-5ca5c2d308a9</serial>
Jul 24 18:21:11 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:21:11 user nova-compute[70375]: </disk>
Jul 24 18:21:11 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:21:11 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully detached device vdc from instance a0176d15-d012-4d0f-8374-73926407c0af from the persistent domain config.
Jul 24 18:21:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a0176d15-d012-4d0f-8374-73926407c0af from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:21:11 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:21:11 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:21:11 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:21:11 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:21:11 user nova-compute[70375]:   <serial>410825c3-9344-45e9-93aa-5ca5c2d308a9</serial>
Jul 24 18:21:11 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 18:21:11 user nova-compute[70375]: </disk>
Jul 24 18:21:11 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690222872.114995, a0176d15-d012-4d0f-8374-73926407c0af => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:21:12 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully detached device vdc from instance a0176d15-d012-4d0f-8374-73926407c0af from the live domain config.
Jul 24 18:21:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUALlNXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:21:12 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[369dc121-9489-4fb4-964a-f9d7f54cacab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:21:12 user nova-compute[70375]: No targets found.
Jul 24 18:21:12 user nova-compute[70375]: iSNS:
Jul 24 18:21:12 user nova-compute[70375]: No targets found.
Jul 24 18:21:12 user nova-compute[70375]: STATIC:
Jul 24 18:21:12 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9
Jul 24 18:21:12 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:21:12 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:21:12 user nova-compute[70375]: FIRMWARE:
Jul 24 18:21:12 user nova-compute[70375]: No targets found.
Jul 24 18:21:12 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:21:12 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:21:12 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[5964dc2e-013a-402b-9d57-c0377c652fdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca66c4-9c07-44d8-b34c-d7ce80bd8f8e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:21:12 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 (non-flash)
Jul 24 18:21:12 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe6481f1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0d307d-150c-4611-b82f-0aacc205d013]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c99115-1640-438e-b0aa-d8d00ea98f96]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f7156-0c2b-4df6-bc1e-ccebc97368ed]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a3fd5d-7903-4806-8a07-85938c0c34f0]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f973913e-cb48-4d69-b51b-02c458bc75aa]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e11e14-c18c-4a7e-8671-737bb78ae79a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260]
Jul 24 18:21:12 user nova-compute[70375]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9, portal: 172.16.0.220,3260] successful.
Jul 24 18:21:12 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410825c3-9344-45e9-93aa-5ca5c2d308a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[810658b7-887b-4b0f-a8a5-2bddde34a3d9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] <== disconnect_volume: return (271ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:21:12 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:21:13 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'flavor' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:21:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b873b94b-b935-4f75-a26e-478503025c45 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:21:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:44 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:50 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [{"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:21:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-c10a72e2-3387-47f7-938e-57f69b58c887" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:21:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:21:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:21:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:21:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:21:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:21:57 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:21:57 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=23.14969253540039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance c10a72e2-3387-47f7-938e-57f69b58c887 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance a0176d15-d012-4d0f-8374-73926407c0af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:21:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:21:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:21:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:01 user nova-compute[70375]: INFO nova.compute.manager [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Terminating instance
Jul 24 18:22:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-7b8bcd25-3b0a-444e-a6b3-63a584b76ccb req-cf1fab70-fe7b-4e1a-a33b-703d4ea85ff9 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-unplugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:22:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Instance destroyed successfully.
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'resources' on Instance uuid a0176d15-d012-4d0f-8374-73926407c0af {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-611132264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-611132264',id=43,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxLRWeub8LXeA2aRnN1YTbmeE9JdTITH7YxBkLzSJL+bLCerRCesS66EtMfIjW7hh6NRso0f4RSYUCYtFmExoRNO1vDwFkfHPkEU0SSgUqaPz3HBkVqKh4yWPkZfoFbhg==',key_name='tempest-keypair-547467386',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-ijtc0i4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=a0176d15-d012-4d0f-8374-73926407c0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "address": "fa:16:3e:94:1a:d5", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a7a498-24", "ovs_interfaceid": "47a7a498-24cf-4fe5-b363-2a7d7bf3ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG os_vif [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47a7a498-24, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:02 user nova-compute[70375]: INFO os_vif [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:1a:d5,bridge_name='br-int',has_traffic_filtering=True,id=47a7a498-24cf-4fe5-b363-2a7d7bf3ceee,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a7a498-24')
Jul 24 18:22:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Deleting instance files /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af_del
Jul 24 18:22:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Deletion of /opt/stack/data/nova/instances/a0176d15-d012-4d0f-8374-73926407c0af_del complete
Jul 24 18:22:02 user nova-compute[70375]: INFO nova.compute.manager [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 18:22:02 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:22:02 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] Acquiring lock "a0176d15-d012-4d0f-8374-73926407c0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] Lock "a0176d15-d012-4d0f-8374-73926407c0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] No waiting events found dispatching network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:04 user nova-compute[70375]: WARNING nova.compute.manager [req-c0f7a8f4-9329-44c5-94ba-55d22e8f157f req-dc9b7155-ce0d-47f6-baa6-646f1860e6f3 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received unexpected event network-vif-plugged-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee for instance with vm_state active and task_state deleting.
Jul 24 18:22:04 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Took 1.54 seconds to deallocate network for instance.
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.compute.manager [req-9ec02f8c-224d-4006-86d5-b5f4c25d39ed req-ecf64164-3027-4d01-8e39-872816a7c6d5 service nova] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Received event network-vif-deleted-47a7a498-24cf-4fe5-b363-2a7d7bf3ceee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:04 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Deleted allocations for instance a0176d15-d012-4d0f-8374-73926407c0af
Jul 24 18:22:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-38c872e5-f377-44e9-861b-fd3c82b1c1c4 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0176d15-d012-4d0f-8374-73926407c0af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.805s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:17 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222922.7510166, a0176d15-d012-4d0f-8374-73926407c0af => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:22:17 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: a0176d15-d012-4d0f-8374-73926407c0af] VM Stopped (Lifecycle Event)
Jul 24 18:22:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-998514d9-c9f2-4cb6-b0b1-fcb0f7269888 None None] [instance: a0176d15-d012-4d0f-8374-73926407c0af] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:22:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:22:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:22:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:34 user nova-compute[70375]: INFO nova.compute.manager [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Terminating instance
Jul 24 18:22:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-1cb64312-d561-431b-9260-11e328fa2c33 req-90ebd375-1431-457e-9b57-b387d263b647 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Instance destroyed successfully.
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.objects.instance [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'resources' on Instance uuid c10a72e2-3387-47f7-938e-57f69b58c887 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1173996728',display_name='tempest-AttachVolumeTestJSON-server-1173996728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1173996728',id=42,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLZBzgxVortb41nWdYw5QGVH6MtgV0Pe59n7uMaikvU55G73+01A+up2T0zf6q+AOlAxPwRSEfb9qjWb+NS6uAsIJOkOISIHhSIGKkCNjp3jIWuVoOtjYCXDrkIDnGSeQ==',key_name='tempest-keypair-1015351766',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-3ea50ewd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=c10a72e2-3387-47f7-938e-57f69b58c887,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "93758659-4637-43ef-b475-16dd6fc2ffb3", "address": "fa:16:3e:cc:6a:95", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93758659-46", "ovs_interfaceid": "93758659-4637-43ef-b475-16dd6fc2ffb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG os_vif [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93758659-46, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:35 user nova-compute[70375]: INFO os_vif [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=93758659-4637-43ef-b475-16dd6fc2ffb3,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93758659-46')
Jul 24 18:22:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Deleting instance files /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887_del
Jul 24 18:22:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Deletion of /opt/stack/data/nova/instances/c10a72e2-3387-47f7-938e-57f69b58c887_del complete
Jul 24 18:22:35 user nova-compute[70375]: INFO nova.compute.manager [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 18:22:35 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:22:36 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Took 1.26 seconds to deallocate network for instance.
Jul 24 18:22:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:36 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Deleted allocations for instance c10a72e2-3387-47f7-938e-57f69b58c887
Jul 24 18:22:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-23bc6220-2895-4319-a29a-96689028a908 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "c10a72e2-3387-47f7-938e-57f69b58c887" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:37 user nova-compute[70375]: WARNING nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state deleted and task_state None.
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:37 user nova-compute[70375]: WARNING nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state deleted and task_state None.
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:37 user nova-compute[70375]: WARNING nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state deleted and task_state None.
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:37 user nova-compute[70375]: WARNING nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-unplugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state deleted and task_state None.
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Acquiring lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] Lock "c10a72e2-3387-47f7-938e-57f69b58c887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] No waiting events found dispatching network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:22:37 user nova-compute[70375]: WARNING nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received unexpected event network-vif-plugged-93758659-4637-43ef-b475-16dd6fc2ffb3 for instance with vm_state deleted and task_state None.
Jul 24 18:22:37 user nova-compute[70375]: DEBUG nova.compute.manager [req-eca7081c-f824-4141-bae8-60238c8ed1a1 req-af514c67-7635-4c3b-b446-b9f75b109006 service nova] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Received event network-vif-deleted-93758659-4637-43ef-b475-16dd6fc2ffb3 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:43 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:47 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:22:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:22:50 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690222955.314687, c10a72e2-3387-47f7-938e-57f69b58c887 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:22:50 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] VM Stopped (Lifecycle Event)
Jul 24 18:22:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8e328a8f-3577-43fa-b9dc-bf5cab8ef5ff None None] [instance: c10a72e2-3387-47f7-938e-57f69b58c887] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:22:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:55 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:22:55 user nova-compute[70375]: INFO nova.compute.claims [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Claim successful on node user
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.policy [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65334a0d26ca4007b4214f0eaf69bb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0898cf4400f1426493ed139b25fb7d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:22:56 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Creating image(s)
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:22:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:22:56 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.20376968383789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 54ecc530-b8d7-4686-ac90-c286a4369523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:22:56 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk 1073741824" returned: 0 in 0.052s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Cannot resize image /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.objects.instance [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'migration_context' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Ensure instance console log exists: /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Successfully created port: 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:22:57 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Successfully updated port: 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-changed-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.compute.manager [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing instance network info cache due to event network-changed-09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.network.neutron [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance network_info: |[{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing network info cache for port 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start _get_guest_xml network_info=[{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:22:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:22:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:22:58 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQxKOiKQENbMCel7XUggBXm6dYPaKO6EHkQxUasreecithKM6dDItTXZ+nxKqwweilLvaXe1vqB5VOPClABHSACW/ddrCwFUY3yaaBrTAGlJNx1ncohOO6yP4dzdjjsZw==',key_name='tempest-keypair-825879102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:22:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.objects.instance [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_devices' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:22:59 user nova-compute[70375]:   <uuid>54ecc530-b8d7-4686-ac90-c286a4369523</uuid>
Jul 24 18:22:59 user nova-compute[70375]:   <name>instance-00000030</name>
Jul 24 18:22:59 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:22:59 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:22:59 user nova-compute[70375]:   <metadata>
Jul 24 18:22:59 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:22:59 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-839049840</nova:name>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:22:58</nova:creationTime>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:22:59 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:22:59 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:owner>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:user uuid="65334a0d26ca4007b4214f0eaf69bb17">tempest-AttachVolumeShelveTestJSON-485068176-project-member</nova:user>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:project uuid="0898cf4400f1426493ed139b25fb7d56">tempest-AttachVolumeShelveTestJSON-485068176</nova:project>
Jul 24 18:22:59 user nova-compute[70375]:       </nova:owner>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:22:59 user nova-compute[70375]:       <nova:ports>
Jul 24 18:22:59 user nova-compute[70375]:         <nova:port uuid="09064729-971e-4347-aa85-1da07ab19d41">
Jul 24 18:22:59 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 18:22:59 user nova-compute[70375]:         </nova:port>
Jul 24 18:22:59 user nova-compute[70375]:       </nova:ports>
Jul 24 18:22:59 user nova-compute[70375]:     </nova:instance>
Jul 24 18:22:59 user nova-compute[70375]:   </metadata>
Jul 24 18:22:59 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:22:59 user nova-compute[70375]:     <system>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="serial">54ecc530-b8d7-4686-ac90-c286a4369523</entry>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="uuid">54ecc530-b8d7-4686-ac90-c286a4369523</entry>
Jul 24 18:22:59 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:22:59 user nova-compute[70375]:     </system>
Jul 24 18:22:59 user nova-compute[70375]:   </sysinfo>
Jul 24 18:22:59 user nova-compute[70375]:   <os>
Jul 24 18:22:59 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:22:59 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:22:59 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:22:59 user nova-compute[70375]:   </os>
Jul 24 18:22:59 user nova-compute[70375]:   <features>
Jul 24 18:22:59 user nova-compute[70375]:     <acpi/>
Jul 24 18:22:59 user nova-compute[70375]:     <apic/>
Jul 24 18:22:59 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:22:59 user nova-compute[70375]:   </features>
Jul 24 18:22:59 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:22:59 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:22:59 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:22:59 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:22:59 user nova-compute[70375]:   </clock>
Jul 24 18:22:59 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:22:59 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:22:59 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:22:59 user nova-compute[70375]:   </cpu>
Jul 24 18:22:59 user nova-compute[70375]:   <devices>
Jul 24 18:22:59 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:22:59 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:22:59 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk"/>
Jul 24 18:22:59 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:22:59 user nova-compute[70375]:     </disk>
Jul 24 18:22:59 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:22:59 user nova-compute[70375]:       <mac address="fa:16:3e:a6:87:3d"/>
Jul 24 18:22:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:22:59 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:22:59 user nova-compute[70375]:       <target dev="tap09064729-97"/>
Jul 24 18:22:59 user nova-compute[70375]:     </interface>
Jul 24 18:22:59 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:22:59 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/console.log" append="off"/>
Jul 24 18:22:59 user nova-compute[70375]:     </serial>
Jul 24 18:22:59 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:22:59 user nova-compute[70375]:     <video>
Jul 24 18:22:59 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:22:59 user nova-compute[70375]:     </video>
Jul 24 18:22:59 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:22:59 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:22:59 user nova-compute[70375]:     </rng>
Jul 24 18:22:59 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:22:59 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:22:59 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:22:59 user nova-compute[70375]:     </memballoon>
Jul 24 18:22:59 user nova-compute[70375]:   </devices>
Jul 24 18:22:59 user nova-compute[70375]: </domain>
Jul 24 18:22:59 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQxKOiKQENbMCel7XUggBXm6dYPaKO6EHkQxUasreecithKM6dDItTXZ+nxKqwweilLvaXe1vqB5VOPClABHSACW/ddrCwFUY3yaaBrTAGlJNx1ncohOO6yP4dzdjjsZw==',key_name='tempest-keypair-825879102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:22:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG os_vif [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09064729-97, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09064729-97, col_values=(('external_ids', {'iface-id': '09064729-971e-4347-aa85-1da07ab19d41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:87:3d', 'vm-uuid': '54ecc530-b8d7-4686-ac90-c286a4369523'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:22:59 user nova-compute[70375]: INFO os_vif [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97')
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No VIF found with MAC fa:16:3e:a6:87:3d, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated VIF entry in instance network info cache for port 09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG nova.network.neutron [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:22:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-3d488fbd-4ee1-445b-8ee9-11b4a8afabe3 req-d6cdf582-ed0b-4676-883d-b4969f6ee286 service nova] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG nova.compute.manager [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:23:00 user nova-compute[70375]: WARNING nova.compute.manager [req-14609420-d92d-426a-a5c8-b762e99e13c7 req-a17a791e-f686-426f-aadb-0756277bd274 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state building and task_state spawning.
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:23:02 user nova-compute[70375]: WARNING nova.compute.manager [req-63fdb2c7-80db-4774-a6f8-88ec597e39d8 req-ab0161ca-8fd5-42e3-a263-d97b1623a00a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state building and task_state spawning.
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222982.7291732, 54ecc530-b8d7-4686-ac90-c286a4369523 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Resumed (Lifecycle Event)
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance spawned successfully.
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690222982.7305577, 54ecc530-b8d7-4686-ac90-c286a4369523 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Started (Lifecycle Event)
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Took 6.19 seconds to spawn the instance on the hypervisor.
Jul 24 18:23:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:02 user nova-compute[70375]: INFO nova.compute.manager [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Took 7.02 seconds to build instance.
Jul 24 18:23:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-af56f2e8-5986-4505-b43f-03f4666d5439 tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.165s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Verify base images {{(pid=70375) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Image id 43e95aac-d02a-49a8-aaa5-04490973ed39 yields fingerprint d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f {{(pid=70375) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] image 43e95aac-d02a-49a8-aaa5-04490973ed39 at (/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f): checking
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] image 43e95aac-d02a-49a8-aaa5-04490973ed39 at (/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f): image is in use {{(pid=70375) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70375) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] 54ecc530-b8d7-4686-ac90-c286a4369523 is a valid instance name {{(pid=70375) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] 54ecc530-b8d7-4686-ac90-c286a4369523 has a disk file {{(pid=70375) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 54ecc530-b8d7-4686-ac90-c286a4369523 is backed by d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f {{(pid=70375) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24
Jul 24 18:23:15 user nova-compute[70375]: WARNING nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Active base files: /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Removable base files: /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214 /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0 /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382 /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24 /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1c4ce8239511d4f71c5653522960442037f2214
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ee78cb2a683758976554472eb1b225a871645b0
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf9646f8bf653ccedd393193ea09353eaf9bfcab
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/145fe3372f05fa0a2065501a6741e55bd2f55fde
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/afa96518d5e218b137798bf83b7662719b913382
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/08d5fa84fa3c84270e6241e07142a58f02016e24
Jul 24 18:23:15 user nova-compute[70375]: INFO nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa2e42a6b68224bc82a70947f291c8b78f4734d4
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Verification complete {{(pid=70375) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Verify swap images {{(pid=70375) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 24 18:23:15 user nova-compute[70375]: DEBUG nova.virt.libvirt.imagecache [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Verify ephemeral images {{(pid=70375) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 24 18:23:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:23:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:23:28 user nova-compute[70375]: INFO nova.compute.claims [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Claim successful on node user
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:23:28 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.policy [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e91fc2ae6a3e4ccaa35a33dc589bcb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c98e21a63a49a5817d6bf54d18dcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:23:28 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Creating image(s)
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "/opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "/opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "/opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk 1073741824" returned: 0 in 0.211s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Cannot resize image /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.objects.instance [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'migration_context' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Ensure instance console log exists: /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Successfully created port: ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Successfully updated port: ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquired lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-changed-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.compute.manager [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Refreshing instance network info cache due to event network-changed-ae4f1eea-35ee-477d-984e-aa69d09297ee. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] Acquiring lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating instance_info_cache with network_info: [{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Releasing lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Instance network_info: |[{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] Acquired lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Refreshing network info cache for port ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Start _get_guest_xml network_info=[{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:23:30 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:23:30 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1675696216',display_name='tempest-AttachVolumeTestJSON-server-1675696216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1675696216',id=49,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHBFg8i//oJCQGf7ifX6FT9pcfJOvOi96Cg/dXOLx/SRdyTvgARdJwQSPJd5z2YlwpZiVNuNVdAtWjJGuRJkrS2YHQZC5aiiMLtKAbkgjL69ZlfEoxVOpJ0dCuLJbbeAA==',key_name='tempest-keypair-913416144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-mcrnkw2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=27d31281-135a-4fd5-86c7-d2f889dd3098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.objects.instance [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'pci_devices' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:23:30 user nova-compute[70375]:   <uuid>27d31281-135a-4fd5-86c7-d2f889dd3098</uuid>
Jul 24 18:23:30 user nova-compute[70375]:   <name>instance-00000031</name>
Jul 24 18:23:30 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:23:30 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:23:30 user nova-compute[70375]:   <metadata>
Jul 24 18:23:30 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:23:30 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeTestJSON-server-1675696216</nova:name>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:23:30</nova:creationTime>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:23:30 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:23:30 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:owner>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:user uuid="e91fc2ae6a3e4ccaa35a33dc589bcb63">tempest-AttachVolumeTestJSON-67425413-project-member</nova:user>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:project uuid="49c98e21a63a49a5817d6bf54d18dcd1">tempest-AttachVolumeTestJSON-67425413</nova:project>
Jul 24 18:23:30 user nova-compute[70375]:       </nova:owner>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:23:30 user nova-compute[70375]:       <nova:ports>
Jul 24 18:23:30 user nova-compute[70375]:         <nova:port uuid="ae4f1eea-35ee-477d-984e-aa69d09297ee">
Jul 24 18:23:30 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 18:23:30 user nova-compute[70375]:         </nova:port>
Jul 24 18:23:30 user nova-compute[70375]:       </nova:ports>
Jul 24 18:23:30 user nova-compute[70375]:     </nova:instance>
Jul 24 18:23:30 user nova-compute[70375]:   </metadata>
Jul 24 18:23:30 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:23:30 user nova-compute[70375]:     <system>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="serial">27d31281-135a-4fd5-86c7-d2f889dd3098</entry>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="uuid">27d31281-135a-4fd5-86c7-d2f889dd3098</entry>
Jul 24 18:23:30 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:23:30 user nova-compute[70375]:     </system>
Jul 24 18:23:30 user nova-compute[70375]:   </sysinfo>
Jul 24 18:23:30 user nova-compute[70375]:   <os>
Jul 24 18:23:30 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:23:30 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:23:30 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:23:30 user nova-compute[70375]:   </os>
Jul 24 18:23:30 user nova-compute[70375]:   <features>
Jul 24 18:23:30 user nova-compute[70375]:     <acpi/>
Jul 24 18:23:30 user nova-compute[70375]:     <apic/>
Jul 24 18:23:30 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:23:30 user nova-compute[70375]:   </features>
Jul 24 18:23:30 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:23:30 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:23:30 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:23:30 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:23:30 user nova-compute[70375]:   </clock>
Jul 24 18:23:30 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:23:30 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:23:30 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:23:30 user nova-compute[70375]:   </cpu>
Jul 24 18:23:30 user nova-compute[70375]:   <devices>
Jul 24 18:23:30 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:23:30 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:23:30 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk"/>
Jul 24 18:23:30 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:23:30 user nova-compute[70375]:     </disk>
Jul 24 18:23:30 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:23:30 user nova-compute[70375]:       <mac address="fa:16:3e:15:80:6d"/>
Jul 24 18:23:30 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:23:30 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:23:30 user nova-compute[70375]:       <target dev="tapae4f1eea-35"/>
Jul 24 18:23:30 user nova-compute[70375]:     </interface>
Jul 24 18:23:30 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:23:30 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/console.log" append="off"/>
Jul 24 18:23:30 user nova-compute[70375]:     </serial>
Jul 24 18:23:30 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:23:30 user nova-compute[70375]:     <video>
Jul 24 18:23:30 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:23:30 user nova-compute[70375]:     </video>
Jul 24 18:23:30 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:23:30 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:23:30 user nova-compute[70375]:     </rng>
Jul 24 18:23:30 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:23:30 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:23:30 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:23:30 user nova-compute[70375]:     </memballoon>
Jul 24 18:23:30 user nova-compute[70375]:   </devices>
Jul 24 18:23:30 user nova-compute[70375]: </domain>
Jul 24 18:23:30 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1675696216',display_name='tempest-AttachVolumeTestJSON-server-1675696216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1675696216',id=49,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHBFg8i//oJCQGf7ifX6FT9pcfJOvOi96Cg/dXOLx/SRdyTvgARdJwQSPJd5z2YlwpZiVNuNVdAtWjJGuRJkrS2YHQZC5aiiMLtKAbkgjL69ZlfEoxVOpJ0dCuLJbbeAA==',key_name='tempest-keypair-913416144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-mcrnkw2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=27d31281-135a-4fd5-86c7-d2f889dd3098,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG os_vif [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae4f1eea-35, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae4f1eea-35, col_values=(('external_ids', {'iface-id': 'ae4f1eea-35ee-477d-984e-aa69d09297ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:80:6d', 'vm-uuid': '27d31281-135a-4fd5-86c7-d2f889dd3098'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:23:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:30 user nova-compute[70375]: INFO os_vif [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35')
Jul 24 18:23:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:23:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No VIF found with MAC fa:16:3e:15:80:6d, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:23:31 user nova-compute[70375]: DEBUG nova.network.neutron [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updated VIF entry in instance network info cache for port ae4f1eea-35ee-477d-984e-aa69d09297ee. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:23:31 user nova-compute[70375]: DEBUG nova.network.neutron [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating instance_info_cache with network_info: [{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:23:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-37b6c60d-fc93-4fbd-a14e-6553307df45d req-99a9b420-0637-4022-894f-feacc005799f service nova] Releasing lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:23:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG nova.compute.manager [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] No waiting events found dispatching network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:23:32 user nova-compute[70375]: WARNING nova.compute.manager [req-e6b25abf-1924-4470-8cb0-3c4d3352ab0b req-aadb3eb8-f296-4fc6-9ec5-673ba04cd527 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received unexpected event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee for instance with vm_state building and task_state spawning.
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223014.4409442, 27d31281-135a-4fd5-86c7-d2f889dd3098 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] VM Resumed (Lifecycle Event)
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Instance spawned successfully.
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223014.4434338, 27d31281-135a-4fd5-86c7-d2f889dd3098 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] VM Started (Lifecycle Event)
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:34 user nova-compute[70375]: DEBUG nova.compute.manager [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] No waiting events found dispatching network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:23:34 user nova-compute[70375]: WARNING nova.compute.manager [req-79b82678-7058-47c5-935e-d128c5dcb22f req-93978070-6d89-4815-8d49-3f5bc7a74dc6 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received unexpected event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee for instance with vm_state building and task_state spawning.
Jul 24 18:23:34 user nova-compute[70375]: INFO nova.compute.manager [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Took 6.21 seconds to build instance.
Jul 24 18:23:34 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-aa802ee7-ef52-45b7-b089-f0f194974d3c tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:45 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:23:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:23:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:23:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:23:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:23:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:23:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:23:57 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:23:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:23:58 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=24.146530151367188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 54ecc530-b8d7-4686-ac90-c286a4369523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 27d31281-135a-4fd5-86c7-d2f889dd3098 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:23:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:23:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:23:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:24 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:24:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-changed-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG nova.compute.manager [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing instance network info cache due to event network-changed-09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:24:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing network info cache for port 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:24:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated VIF entry in instance network info cache for port 09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:24:47 user nova-compute[70375]: DEBUG nova.network.neutron [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:24:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-58fdf246-1980-4d45-b295-f49e0627e16a req-6af2b3b4-0d67-4a56-8f66-a9e2d295a3f7 service nova] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:50 user nova-compute[70375]: INFO nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] During sync_power_state the instance has a pending task (shelving). Skip.
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:50 user nova-compute[70375]: INFO nova.compute.manager [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Shelving
Jul 24 18:24:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:24:50 user nova-compute[70375]: WARNING nova.compute.manager [req-4ccb0385-4e1f-4db0-b3dd-e099c0e96bed req-47075efa-0b6c-4a11-8f2e-bbd737b75eb9 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state active and task_state shelving.
Jul 24 18:24:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance destroyed successfully.
Jul 24 18:24:51 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:51 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Beginning cold snapshot process
Jul 24 18:24:51 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:24:51 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk /opt/stack/data/nova/instances/snapshots/tmpwgm0ef31/f04aab4c20754d45a5e836e1124e16f0 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:24:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk /opt/stack/data/nova/instances/snapshots/tmpwgm0ef31/f04aab4c20754d45a5e836e1124e16f0" returned: 0 in 0.627s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:24:52 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Snapshot extracted, beginning image upload
Jul 24 18:24:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:52 user nova-compute[70375]: DEBUG nova.compute.manager [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:24:52 user nova-compute[70375]: WARNING nova.compute.manager [req-d1bbd463-f90b-4361-818a-c4153c2d9f73 req-ae57af4b-e8d8-441a-b72b-625154271c3c service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:24:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Snapshot image upload complete
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:24:54 user nova-compute[70375]: INFO nova.compute.manager [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Shelve offloading
Jul 24 18:24:54 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance destroyed successfully.
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating instance_info_cache with network_info: [{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG nova.network.neutron [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:24:54 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:24:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance destroyed successfully.
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.objects.instance [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'resources' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQxKOiKQENbMCel7XUggBXm6dYPaKO6EHkQxUasreecithKM6dDItTXZ+nxKqwweilLvaXe1vqB5VOPClABHSACW/ddrCwFUY3yaaBrTAGlJNx1ncohOO6yP4dzdjjsZw==',key_name='tempest-keypair-825879102',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:24:54.435474',shelved_host='user',shelved_image_id='ddf2c1ad-ba12-4a07-802f-ede37c81339d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG os_vif [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09064729-97, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:24:55 user nova-compute[70375]: INFO os_vif [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97')
Jul 24 18:24:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Deleting instance files /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523_del
Jul 24 18:24:55 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Deletion of /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523_del complete
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-changed-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.compute.manager [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing instance network info cache due to event network-changed-09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.network.neutron [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing network info cache for port 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:24:55 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Deleted allocations for instance 54ecc530-b8d7-4686-ac90-c286a4369523
Jul 24 18:24:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.objects.instance [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'numa_topology' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:24:55 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-154ed73c-15cb-4872-9309-7cf3c5441d5b tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.612s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated VIF entry in instance network info cache for port 09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG nova.network.neutron [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap09064729-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-da87d6b2-52c9-430c-b019-95422404400b req-aafa0261-75d2-4a15-a09e-d82bfe56d1e5 service nova] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:24:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:24:58 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:24:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:24:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=24.123294830322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 27d31281-135a-4fd5-86c7-d2f889dd3098 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:24:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:06 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690223091.2095687, 54ecc530-b8d7-4686-ac90-c286a4369523 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:25:06 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Stopped (Lifecycle Event)
Jul 24 18:25:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3d05ed5a-61a4-47b6-a7d1-5720abc1aa4d None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:25:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-changed-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Refreshing instance network info cache due to event network-changed-ae4f1eea-35ee-477d-984e-aa69d09297ee. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] Acquiring lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] Acquired lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Refreshing network info cache for port ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updated VIF entry in instance network info cache for port ae4f1eea-35ee-477d-984e-aa69d09297ee. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating instance_info_cache with network_info: [{"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:25:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-88b6fed0-9ce0-4007-98dc-b5ed8e93a47a req-3ec70e1e-6301-4d16-b0f3-6aef15efb110 service nova] Releasing lock "refresh_cache-27d31281-135a-4fd5-86c7-d2f889dd3098" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:25:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:22 user nova-compute[70375]: INFO nova.compute.manager [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attaching volume d9f67a21-c01b-47a4-9b77-bb4c2d799436 to /dev/vdb
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.utils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ce8aac-4de3-4219-a5be-27de7d49fcfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f31d9-6778-4d2c-9a6c-23a1b9e7adef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ebc2e5-410d-4f26-b467-7e348e568a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f31dd-50b6-4baf-886d-c67d77f9f1fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:25:22 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:25:22 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[13865fa8-e247-440e-8012-01ec907c273b]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG os_brick.utils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:22 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating existing volume attachment record: 8645ce68-c0d4-47bf-a14b-1fe949c6ad76 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:25:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFhuBaSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:28 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:28 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:28 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90534f-7a8f-4fd1-9aa5-f9b79c6298b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:25:28 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346fb9a-1966-432e-8c9c-dad700302534]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436] added
Jul 24 18:25:28 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc2651-aeb3-4d6b-8080-fcd10c8058c4]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c2d71-68e6-4ec3-812a-f0801830b147]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFhuBaSz {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFhuBaSz" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f379e-50f0-42c2-8a31-8057ffe07807]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFhuBaSz'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11157d5-12e7-4507-880c-66bc13d8fabd]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ba15a-8033-427b-a56c-1b6f116d9226]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:25:28 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:25:28 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:28 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 18:25:28 user nova-compute[70375]: 
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d78e7cb-4ac2-486c-b78c-e3b01fad1517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260]
Jul 24 18:25:28 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260] successful.
Jul 24 18:25:28 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deee43f-46ea-4736-b3b5-07068d695346]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2598853-20c4-4252-ad3f-be4e2b0071a2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:28 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:28 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b084f164-d989-49df-8cb4-6e419e7151a0]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:25:28 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFhuBaSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:25:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:29 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26439373961666664', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439373961666664', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:25:29 user nova-compute[70375]: DEBUG nova.objects.instance [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:29 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:25:29 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:29 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:25:29 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:25:29 user nova-compute[70375]:   <serial>d9f67a21-c01b-47a4-9b77-bb4c2d799436</serial>
Jul 24 18:25:29 user nova-compute[70375]: </disk>
Jul 24 18:25:29 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:25:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:25:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:25:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No VIF found with MAC fa:16:3e:15:80:6d, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:25:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-f55fa9e1-3cea-495b-b7d7-164077c2efaf tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.126s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:33 user nova-compute[70375]: INFO nova.compute.manager [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attaching volume 3c916525-60f2-4da2-aca9-6c5c615e61b7 to /dev/vdc
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.utils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac35a8-79cc-4ebc-9896-5a4e52e560d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371b2bf-306a-488b-b442-bc024b371115]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b518b1-3d74-4844-a6d9-f2f57176b301]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5abdef-6cb0-40e6-a4df-403b60e91371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:25:33 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:25:33 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd1383-8cb5-48bb-94d8-a0b09640a32d]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG os_brick.utils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:33 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating existing volume attachment record: f4e72211-f6ea-4ffc-9518-f2a670d6af57 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:25:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDRtTIzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:39 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:39 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:39 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa13ae-c5ce-441b-9c12-da5906ae2b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:25:39 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e299121d-548f-4b41-a4a3-0f1ef9f94a4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7] added
Jul 24 18:25:39 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:39 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b5e65-8ed8-497d-8be2-1b0eaeeebdc2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[92467c41-95d2-4780-a11d-22d80f508c9d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDRtTIzF {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDRtTIzF" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e601070-e2d6-41a4-85b8-71eff4f756c9]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDRtTIzF'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.120s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f131d66d-0de0-45d3-a1e9-a9136b34b93f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbea80f-1040-4d8c-86d4-73f7128a6c06]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392cf76-e302-408b-bf48-7936f0e133e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260]
Jul 24 18:25:40 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260] successful.
Jul 24 18:25:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[32def549-bf2f-4ec0-b673-f8398d366809]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dde944-5fbc-4541-b62a-f7ae3a149faa]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:40 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f24a8e-82d9-4ddc-8c5e-7a28d4169ec0]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:25:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDRtTIzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23662363234613432', 'path': '/dev/sdc'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662363234613432', 'path': '/dev/sdc'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.objects.instance [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:25:41 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:41 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 18:25:41 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:25:41 user nova-compute[70375]:   <serial>3c916525-60f2-4da2-aca9-6c5c615e61b7</serial>
Jul 24 18:25:41 user nova-compute[70375]: </disk>
Jul 24 18:25:41 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] No VIF found with MAC fa:16:3e:15:80:6d, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:25:41 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-4b30b4bd-411a-4909-82fd-dffaea048214 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.178s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:42 user nova-compute[70375]: INFO nova.compute.manager [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Detaching volume d9f67a21-c01b-47a4-9b77-bb4c2d799436
Jul 24 18:25:42 user nova-compute[70375]: INFO nova.virt.block_device [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attempting to driver detach volume d9f67a21-c01b-47a4-9b77-bb4c2d799436 from mountpoint /dev/vdb
Jul 24 18:25:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Attempting to detach device vdb from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:25:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:25:42 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:42 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:25:42 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:25:42 user nova-compute[70375]:   <serial>d9f67a21-c01b-47a4-9b77-bb4c2d799436</serial>
Jul 24 18:25:42 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:25:42 user nova-compute[70375]: </disk>
Jul 24 18:25:42 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:25:42 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdb from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the persistent domain config.
Jul 24 18:25:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:25:42 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:25:42 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:42 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:25:42 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:25:42 user nova-compute[70375]:   <serial>d9f67a21-c01b-47a4-9b77-bb4c2d799436</serial>
Jul 24 18:25:42 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:25:42 user nova-compute[70375]: </disk>
Jul 24 18:25:42 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690223143.2491684, 27d31281-135a-4fd5-86c7-d2f889dd3098 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:25:43 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdb from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the live domain config.
Jul 24 18:25:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFhuBaSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:43 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f703c4-dad4-48e6-860f-8d404af00c62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:25:43 user nova-compute[70375]: No targets found.
Jul 24 18:25:43 user nova-compute[70375]: iSNS:
Jul 24 18:25:43 user nova-compute[70375]: No targets found.
Jul 24 18:25:43 user nova-compute[70375]: STATIC:
Jul 24 18:25:43 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7
Jul 24 18:25:43 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:25:43 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:25:43 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436
Jul 24 18:25:43 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:25:43 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:25:43 user nova-compute[70375]: FIRMWARE:
Jul 24 18:25:43 user nova-compute[70375]: No targets found.
Jul 24 18:25:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:25:43 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:25:43 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3615da-cb7f-48a4-b1e0-1056a7d7bd59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2effa-87d4-43bf-836a-452cc89406da]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:43 user nova-compute[70375]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 (non-flash)
Jul 24 18:25:43 user nova-compute[70375]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe64828f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f884ae84-17bc-472c-aedf-a101074be250]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d77be5-02b9-40fe-b135-0f0ccf3d6d60]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[66825a0c-601b-4c1c-8b5e-9584be3b8bf3]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[296d72d8-2d1a-4254-a9c1-bf807932ac1a]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4114fc0a-6fed-4d67-9499-f947a82b6752]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5840b9b-3aea-456c-810a-3b2939d3fc57]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260]
Jul 24 18:25:43 user nova-compute[70375]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436, portal: 172.16.0.220,3260] successful.
Jul 24 18:25:43 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f67a21-c01b-47a4-9b77-bb4c2d799436 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19f04b6-b673-4df3-bca0-9c02df6c353e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== disconnect_volume: return (311ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:43 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:25:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-54364f26-5a76-4c9f-b19a-e86b8676bce9 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:45 user nova-compute[70375]: INFO nova.compute.manager [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Detaching volume 3c916525-60f2-4da2-aca9-6c5c615e61b7
Jul 24 18:25:45 user nova-compute[70375]: INFO nova.virt.block_device [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Attempting to driver detach volume 3c916525-60f2-4da2-aca9-6c5c615e61b7 from mountpoint /dev/vdc
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Attempting to detach device vdc from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:25:45 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:45 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 18:25:45 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:25:45 user nova-compute[70375]:   <serial>3c916525-60f2-4da2-aca9-6c5c615e61b7</serial>
Jul 24 18:25:45 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 18:25:45 user nova-compute[70375]: </disk>
Jul 24 18:25:45 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:25:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdc from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the persistent domain config.
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:25:45 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:25:45 user nova-compute[70375]:   <source dev="/dev/sdc"/>
Jul 24 18:25:45 user nova-compute[70375]:   <target dev="vdc" bus="virtio"/>
Jul 24 18:25:45 user nova-compute[70375]:   <serial>3c916525-60f2-4da2-aca9-6c5c615e61b7</serial>
Jul 24 18:25:45 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 18:25:45 user nova-compute[70375]: </disk>
Jul 24 18:25:45 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690223145.7652879, 27d31281-135a-4fd5-86c7-d2f889dd3098 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:25:45 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully detached device vdc from instance 27d31281-135a-4fd5-86c7-d2f889dd3098 from the live domain config.
Jul 24 18:25:45 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDRtTIzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:25:45 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[02541487-d5c9-4818-95c5-59544cb07ce5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:25:45 user nova-compute[70375]: No targets found.
Jul 24 18:25:45 user nova-compute[70375]: iSNS:
Jul 24 18:25:45 user nova-compute[70375]: No targets found.
Jul 24 18:25:45 user nova-compute[70375]: STATIC:
Jul 24 18:25:45 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7
Jul 24 18:25:45 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:25:45 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:25:45 user nova-compute[70375]: FIRMWARE:
Jul 24 18:25:45 user nova-compute[70375]: No targets found.
Jul 24 18:25:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:25:45 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:25:45 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b1467-4296-4676-a522-89e2fc0e349a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03213f-cf3f-4856-b701-9e98ac39dce4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 (non-flash)
Jul 24 18:25:45 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe63036b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7'): ({'sdc'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Removing single pathed devices sdc {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[25100833-d274-4520-8b86-059e1c45d187]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd7e7f7-7a21-409e-9258-fd63887fcd57]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Flushing IO for device /dev/sdc {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[984280f4-5ab8-493e-a30f-d442ae4e6cc0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c55928-9333-4081-bf2d-800e755d21b8]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] SCSI volumes sdc have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592f67e-c15b-4ed5-882c-d4ded05598fc]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8aefa-6b38-42e7-b524-c01bbce2e21b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260]
Jul 24 18:25:46 user nova-compute[70375]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7, portal: 172.16.0.220,3260] successful.
Jul 24 18:25:46 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c916525-60f2-4da2-aca9-6c5c615e61b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e333dadc-fde8-4e80-86f4-c1c11943418d]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] <== disconnect_volume: return (287ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG nova.objects.instance [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'flavor' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-706f3b35-a3c0-4224-91d6-1d2a4e10bfd2 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.570s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:47 user nova-compute[70375]: INFO nova.compute.manager [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Terminating instance
Jul 24 18:25:47 user nova-compute[70375]: DEBUG nova.compute.manager [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-unplugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] No waiting events found dispatching network-vif-unplugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.compute.manager [req-7591c6ec-34a8-4d7c-ade7-797fb990759d req-7cd7cc5d-5c0b-4b83-93f6-816f7ed2d92a service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-unplugged-ae4f1eea-35ee-477d-984e-aa69d09297ee for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:25:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Instance destroyed successfully.
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.objects.instance [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lazy-loading 'resources' on Instance uuid 27d31281-135a-4fd5-86c7-d2f889dd3098 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1675696216',display_name='tempest-AttachVolumeTestJSON-server-1675696216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1675696216',id=49,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHBFg8i//oJCQGf7ifX6FT9pcfJOvOi96Cg/dXOLx/SRdyTvgARdJwQSPJd5z2YlwpZiVNuNVdAtWjJGuRJkrS2YHQZC5aiiMLtKAbkgjL69ZlfEoxVOpJ0dCuLJbbeAA==',key_name='tempest-keypair-913416144',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:23:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49c98e21a63a49a5817d6bf54d18dcd1',ramdisk_id='',reservation_id='r-mcrnkw2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-67425413',owner_user_name='tempest-AttachVolumeTestJSON-67425413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91fc2ae6a3e4ccaa35a33dc589bcb63',uuid=27d31281-135a-4fd5-86c7-d2f889dd3098,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converting VIF {"id": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "address": "fa:16:3e:15:80:6d", "network": {"id": "043610b1-03c8-463e-9981-74d94aea3d13", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1674919012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49c98e21a63a49a5817d6bf54d18dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae4f1eea-35", "ovs_interfaceid": "ae4f1eea-35ee-477d-984e-aa69d09297ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG os_vif [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae4f1eea-35, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:48 user nova-compute[70375]: INFO os_vif [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=ae4f1eea-35ee-477d-984e-aa69d09297ee,network=Network(043610b1-03c8-463e-9981-74d94aea3d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae4f1eea-35')
Jul 24 18:25:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Deleting instance files /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098_del
Jul 24 18:25:48 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Deletion of /opt/stack/data/nova/instances/27d31281-135a-4fd5-86c7-d2f889dd3098_del complete
Jul 24 18:25:48 user nova-compute[70375]: INFO nova.compute.manager [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 24 18:25:48 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:25:48 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:25:49 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:25:49 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Took 0.91 seconds to deallocate network for instance.
Jul 24 18:25:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:49 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:25:49 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:25:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:49 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Deleted allocations for instance 27d31281-135a-4fd5-86c7-d2f889dd3098
Jul 24 18:25:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-527a18ec-f787-4fa9-b33f-c9ec114f4e64 tempest-AttachVolumeTestJSON-67425413 tempest-AttachVolumeTestJSON-67425413-project-member] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:25:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] Acquiring lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:50 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] Lock "27d31281-135a-4fd5-86c7-d2f889dd3098-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] No waiting events found dispatching network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:25:50 user nova-compute[70375]: WARNING nova.compute.manager [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received unexpected event network-vif-plugged-ae4f1eea-35ee-477d-984e-aa69d09297ee for instance with vm_state deleted and task_state None.
Jul 24 18:25:50 user nova-compute[70375]: DEBUG nova.compute.manager [req-ed42bb94-2c6f-413a-a63d-1512c21d83ea req-1db5661e-1097-4e55-af86-61d2d2d4b55d service nova] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Received event network-vif-deleted-ae4f1eea-35ee-477d-984e-aa69d09297ee {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:25:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:55 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:25:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:25:55 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:25:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:25:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:25:59 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=24.14175033569336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:25:59 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:03 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690223148.6973207, 27d31281-135a-4fd5-86c7-d2f889dd3098 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:26:03 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] VM Stopped (Lifecycle Event)
Jul 24 18:26:03 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ffe59d67-96be-4ffc-8205-0976a8223765 None None] [instance: 27d31281-135a-4fd5-86c7-d2f889dd3098] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:26:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:26:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:26:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:26:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:26:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:42 user nova-compute[70375]: INFO nova.compute.manager [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Unshelving
Jul 24 18:26:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_requests' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'numa_topology' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:42 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:26:42 user nova-compute[70375]: INFO nova.compute.claims [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Claim successful on node user
Jul 24 18:26:43 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:43 user nova-compute[70375]: INFO nova.network.neutron [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating port 09064729-971e-4347-aa85-1da07ab19d41 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG nova.network.neutron [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-changed-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG nova.compute.manager [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing instance network info cache due to event network-changed-09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:26:43 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG nova.network.neutron [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:26:44 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Creating image(s)
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'trusted_certs' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG nova.network.neutron [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Refreshing network info cache for port 09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0d8f5704039101096a278401c3839e3dcfde51a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:44 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0d8f5704039101096a278401c3839e3dcfde51a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:45 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.part --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG nova.virt.images [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] ddf2c1ad-ba12-4a07-802f-ede37c81339d was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.part /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated VIF entry in instance network info cache for port 09064729-971e-4347-aa85-1da07ab19d41. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG nova.network.neutron [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-0d7af135-ab41-4417-999c-22d85b4b868d req-bcbfbcdd-6f97-45bb-976f-48be2a77ca19 service nova] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.part /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.converted" returned: 0 in 0.548s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0d8f5704039101096a278401c3839e3dcfde51a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.057s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json" returned: 0 in 0.156s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "a0d8f5704039101096a278401c3839e3dcfde51a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0d8f5704039101096a278401c3839e3dcfde51a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:46 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json" returned: 0 in 0.152s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a,backing_fmt=raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a,backing_fmt=raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk 1073741824" returned: 0 in 0.050s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "a0d8f5704039101096a278401c3839e3dcfde51a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0d8f5704039101096a278401c3839e3dcfde51a --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'migration_context' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:47 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Rebasing disk image.
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.132s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:47 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f -F raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:26:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f -F raw /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk" returned: 0 in 2.130s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Ensure instance console log exists: /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start _get_guest_xml network_info=[{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d3cecefbc1a6911fe8252832e1feb745',container_format='bare',created_at=2023-07-24T18:24:50Z,direct_url=<?>,disk_format='qcow2',id=ddf2c1ad-ba12-4a07-802f-ede37c81339d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-839049840-shelved',owner='0898cf4400f1426493ed139b25fb7d56',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T18:24:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:26:49 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:26:49 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d3cecefbc1a6911fe8252832e1feb745',container_format='bare',created_at=2023-07-24T18:24:50Z,direct_url=<?>,disk_format='qcow2',id=ddf2c1ad-ba12-4a07-802f-ede37c81339d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-839049840-shelved',owner='0898cf4400f1426493ed139b25fb7d56',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T18:24:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='ddf2c1ad-ba12-4a07-802f-ede37c81339d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-825879102',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:24:54.435474',shelved_host='user',shelved_image_id='ddf2c1ad-ba12-4a07-802f-ede37c81339d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'pci_devices' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:26:49 user nova-compute[70375]:   <uuid>54ecc530-b8d7-4686-ac90-c286a4369523</uuid>
Jul 24 18:26:49 user nova-compute[70375]:   <name>instance-00000030</name>
Jul 24 18:26:49 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:26:49 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:26:49 user nova-compute[70375]:   <metadata>
Jul 24 18:26:49 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:26:49 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-839049840</nova:name>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:26:49</nova:creationTime>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:26:49 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:26:49 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:owner>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:user uuid="65334a0d26ca4007b4214f0eaf69bb17">tempest-AttachVolumeShelveTestJSON-485068176-project-member</nova:user>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:project uuid="0898cf4400f1426493ed139b25fb7d56">tempest-AttachVolumeShelveTestJSON-485068176</nova:project>
Jul 24 18:26:49 user nova-compute[70375]:       </nova:owner>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:root type="image" uuid="ddf2c1ad-ba12-4a07-802f-ede37c81339d"/>
Jul 24 18:26:49 user nova-compute[70375]:       <nova:ports>
Jul 24 18:26:49 user nova-compute[70375]:         <nova:port uuid="09064729-971e-4347-aa85-1da07ab19d41">
Jul 24 18:26:49 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 18:26:49 user nova-compute[70375]:         </nova:port>
Jul 24 18:26:49 user nova-compute[70375]:       </nova:ports>
Jul 24 18:26:49 user nova-compute[70375]:     </nova:instance>
Jul 24 18:26:49 user nova-compute[70375]:   </metadata>
Jul 24 18:26:49 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:26:49 user nova-compute[70375]:     <system>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="serial">54ecc530-b8d7-4686-ac90-c286a4369523</entry>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="uuid">54ecc530-b8d7-4686-ac90-c286a4369523</entry>
Jul 24 18:26:49 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:26:49 user nova-compute[70375]:     </system>
Jul 24 18:26:49 user nova-compute[70375]:   </sysinfo>
Jul 24 18:26:49 user nova-compute[70375]:   <os>
Jul 24 18:26:49 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:26:49 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:26:49 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:26:49 user nova-compute[70375]:   </os>
Jul 24 18:26:49 user nova-compute[70375]:   <features>
Jul 24 18:26:49 user nova-compute[70375]:     <acpi/>
Jul 24 18:26:49 user nova-compute[70375]:     <apic/>
Jul 24 18:26:49 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:26:49 user nova-compute[70375]:   </features>
Jul 24 18:26:49 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:26:49 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:26:49 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:26:49 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:26:49 user nova-compute[70375]:   </clock>
Jul 24 18:26:49 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:26:49 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:26:49 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:26:49 user nova-compute[70375]:   </cpu>
Jul 24 18:26:49 user nova-compute[70375]:   <devices>
Jul 24 18:26:49 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:26:49 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:26:49 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk"/>
Jul 24 18:26:49 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:26:49 user nova-compute[70375]:     </disk>
Jul 24 18:26:49 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:26:49 user nova-compute[70375]:       <mac address="fa:16:3e:a6:87:3d"/>
Jul 24 18:26:49 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:26:49 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:26:49 user nova-compute[70375]:       <target dev="tap09064729-97"/>
Jul 24 18:26:49 user nova-compute[70375]:     </interface>
Jul 24 18:26:49 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:26:49 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/console.log" append="off"/>
Jul 24 18:26:49 user nova-compute[70375]:     </serial>
Jul 24 18:26:49 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:26:49 user nova-compute[70375]:     <video>
Jul 24 18:26:49 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:26:49 user nova-compute[70375]:     </video>
Jul 24 18:26:49 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:26:49 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:26:49 user nova-compute[70375]:     </rng>
Jul 24 18:26:49 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:26:49 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:26:49 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:26:49 user nova-compute[70375]:     </memballoon>
Jul 24 18:26:49 user nova-compute[70375]:   </devices>
Jul 24 18:26:49 user nova-compute[70375]: </domain>
Jul 24 18:26:49 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='ddf2c1ad-ba12-4a07-802f-ede37c81339d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-825879102',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member',shelved_at='2023-07-24T18:24:54.435474',shelved_host='user',shelved_image_id='ddf2c1ad-ba12-4a07-802f-ede37c81339d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG os_vif [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09064729-97, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09064729-97, col_values=(('external_ids', {'iface-id': '09064729-971e-4347-aa85-1da07ab19d41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:87:3d', 'vm-uuid': '54ecc530-b8d7-4686-ac90-c286a4369523'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:49 user nova-compute[70375]: INFO os_vif [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97')
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:26:49 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] No VIF found with MAC fa:16:3e:a6:87:3d, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG nova.compute.manager [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:26:51 user nova-compute[70375]: WARNING nova.compute.manager [req-28435438-7df9-44e2-8919-73dccc02a0b7 req-e5cb954f-1dd2-4ffb-888e-7b69d8661521 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223213.482655, 54ecc530-b8d7-4686-ac90-c286a4369523 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:26:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Resumed (Lifecycle Event)
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:26:53 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance spawned successfully.
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:26:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223213.4842803, 54ecc530-b8d7-4686-ac90-c286a4369523 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:26:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Started (Lifecycle Event)
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:26:53 user nova-compute[70375]: WARNING nova.compute.manager [req-7481a7f3-28b9-4205-852f-e21446d596ea req-154cd637-53af-4e21-9063-8527f15cae7a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 18:26:53 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:26:53 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:26:53 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3d449e73-7742-4f09-aa83-9c634aefbaaf tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:26:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:26:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:57 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:26:57 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:26:57 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:26:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:26:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:27:01 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:27:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:27:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=24.114967346191406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 54ecc530-b8d7-4686-ac90-c286a4369523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:27:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:27:03 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:34 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:39 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:44 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:46 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:49 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:27:54 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [{"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-54ecc530-b8d7-4686-ac90-c286a4369523" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:27:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:27:59 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:28:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:28:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:28:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=24.112258911132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance 54ecc530-b8d7-4686-ac90-c286a4369523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:28:03 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:05 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:09 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:14 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:19 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:29 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:33 user nova-compute[70375]: INFO nova.compute.manager [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Terminating instance
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-259149cb-cb25-45e8-8a35-566530fbb258 req-e6ac69bf-d8e0-4960-9a64-ae2de1fa6929 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-unplugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:28:33 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Instance destroyed successfully.
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.objects.instance [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lazy-loading 'resources' on Instance uuid 54ecc530-b8d7-4686-ac90-c286a4369523 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T18:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839049840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839049840',id=48,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQxKOiKQENbMCel7XUggBXm6dYPaKO6EHkQxUasreecithKM6dDItTXZ+nxKqwweilLvaXe1vqB5VOPClABHSACW/ddrCwFUY3yaaBrTAGlJNx1ncohOO6yP4dzdjjsZw==',key_name='tempest-keypair-825879102',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0898cf4400f1426493ed139b25fb7d56',ramdisk_id='',reservation_id='r-73zqplib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-485068176',owner_user_name='tempest-AttachVolumeShelveTestJSON-485068176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65334a0d26ca4007b4214f0eaf69bb17',uuid=54ecc530-b8d7-4686-ac90-c286a4369523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converting VIF {"id": "09064729-971e-4347-aa85-1da07ab19d41", "address": "fa:16:3e:a6:87:3d", "network": {"id": "9586cfc0-b972-40c9-a583-500df1e4ba88", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1545433572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0898cf4400f1426493ed139b25fb7d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09064729-97", "ovs_interfaceid": "09064729-971e-4347-aa85-1da07ab19d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG os_vif [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09064729-97, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:33 user nova-compute[70375]: INFO os_vif [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:87:3d,bridge_name='br-int',has_traffic_filtering=True,id=09064729-971e-4347-aa85-1da07ab19d41,network=Network(9586cfc0-b972-40c9-a583-500df1e4ba88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09064729-97')
Jul 24 18:28:33 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Deleting instance files /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523_del
Jul 24 18:28:33 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Deletion of /opt/stack/data/nova/instances/54ecc530-b8d7-4686-ac90-c286a4369523_del complete
Jul 24 18:28:34 user nova-compute[70375]: INFO nova.compute.manager [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 24 18:28:34 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:28:34 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:28:34 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:28:35 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Took 1.28 seconds to deallocate network for instance.
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-81cb6667-b349-412b-8b32-9686bfcc7db6 req-372e9d68-9433-4b7b-9227-aa6b23c7b42a service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-deleted-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:35 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Deleted allocations for instance 54ecc530-b8d7-4686-ac90-c286a4369523
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-8be689d1-817c-4eb5-92a0-3e64b13efc1c tempest-AttachVolumeShelveTestJSON-485068176 tempest-AttachVolumeShelveTestJSON-485068176-project-member] Lock "54ecc530-b8d7-4686-ac90-c286a4369523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] Acquiring lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] Lock "54ecc530-b8d7-4686-ac90-c286a4369523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:28:35 user nova-compute[70375]: DEBUG nova.compute.manager [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] No waiting events found dispatching network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:28:35 user nova-compute[70375]: WARNING nova.compute.manager [req-538d1a95-0b75-42c4-b1f0-a0a108a3d03b req-3361d68a-f566-4bea-9d86-9995c325f327 service nova] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Received unexpected event network-vif-plugged-09064729-971e-4347-aa85-1da07ab19d41 for instance with vm_state deleted and task_state None.
Jul 24 18:28:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690223313.8981774, 54ecc530-b8d7-4686-ac90-c286a4369523 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:28:48 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] VM Stopped (Lifecycle Event)
Jul 24 18:28:48 user nova-compute[70375]: DEBUG nova.compute.manager [None req-32cb28c2-b842-4ecd-aadc-3d432ecd364a None None] [instance: 54ecc530-b8d7-4686-ac90-c286a4369523] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:28:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:50 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:28:50 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:28:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:28:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:28:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:29:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:29:02 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=24.139007568359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:29:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:29:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:29:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:17 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:23 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:28 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:29:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:29:33 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:38 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:43 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:48 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:53 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:29:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:29:58 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:29:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:00 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:30:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:30:00 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:30:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:30:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:03 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:03 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:30:04 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:30:04 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.129058837890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:30:05 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:13 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:30:17 user nova-compute[70375]: INFO nova.compute.claims [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Claim successful on node user
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:30:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:30:17 user nova-compute[70375]: DEBUG nova.policy [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07b8862fd05747eb89d991340af7ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76148e944c8e4f518a28afc43b633794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:30:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Creating image(s)
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "/opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "/opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "/opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.146s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk 1073741824" returned: 0 in 0.046s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk. size=1073741824 {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.virt.disk.api [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Cannot resize image /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk to a smaller size. {{(pid=70375) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'migration_context' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Ensure instance console log exists: /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Successfully created port: 84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:30:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Successfully updated port: 84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.compute.manager [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing instance network info cache due to event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.network.neutron [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Instance network_info: |[{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.network.neutron [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Start _get_guest_xml network_info=[{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '43e95aac-d02a-49a8-aaa5-04490973ed39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:30:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:30:19 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:30:19 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T17:43:43Z,direct_url=<?>,disk_format='qcow2',id=43e95aac-d02a-49a8-aaa5-04490973ed39,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1e181dcf731f4b52a8e3e21f80c1b37d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T17:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2059777208',display_name='tempest-TestStampPattern-server-2059777208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2059777208',id=50,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-atc3myfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:30:18Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=e792dbd0-3ec4-4b2b-b2c8-45c11e568282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'pci_devices' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:30:20 user nova-compute[70375]:   <uuid>e792dbd0-3ec4-4b2b-b2c8-45c11e568282</uuid>
Jul 24 18:30:20 user nova-compute[70375]:   <name>instance-00000032</name>
Jul 24 18:30:20 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:30:20 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:30:20 user nova-compute[70375]:   <metadata>
Jul 24 18:30:20 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:30:20 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:name>tempest-TestStampPattern-server-2059777208</nova:name>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:30:19</nova:creationTime>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:30:20 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:30:20 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:owner>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:user uuid="07b8862fd05747eb89d991340af7ca10">tempest-TestStampPattern-2111286489-project-member</nova:user>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:project uuid="76148e944c8e4f518a28afc43b633794">tempest-TestStampPattern-2111286489</nova:project>
Jul 24 18:30:20 user nova-compute[70375]:       </nova:owner>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:root type="image" uuid="43e95aac-d02a-49a8-aaa5-04490973ed39"/>
Jul 24 18:30:20 user nova-compute[70375]:       <nova:ports>
Jul 24 18:30:20 user nova-compute[70375]:         <nova:port uuid="84d84a4a-6c9b-4473-a7b6-a87337d14c68">
Jul 24 18:30:20 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 18:30:20 user nova-compute[70375]:         </nova:port>
Jul 24 18:30:20 user nova-compute[70375]:       </nova:ports>
Jul 24 18:30:20 user nova-compute[70375]:     </nova:instance>
Jul 24 18:30:20 user nova-compute[70375]:   </metadata>
Jul 24 18:30:20 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:30:20 user nova-compute[70375]:     <system>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="serial">e792dbd0-3ec4-4b2b-b2c8-45c11e568282</entry>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="uuid">e792dbd0-3ec4-4b2b-b2c8-45c11e568282</entry>
Jul 24 18:30:20 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:30:20 user nova-compute[70375]:     </system>
Jul 24 18:30:20 user nova-compute[70375]:   </sysinfo>
Jul 24 18:30:20 user nova-compute[70375]:   <os>
Jul 24 18:30:20 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:30:20 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:30:20 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:30:20 user nova-compute[70375]:   </os>
Jul 24 18:30:20 user nova-compute[70375]:   <features>
Jul 24 18:30:20 user nova-compute[70375]:     <acpi/>
Jul 24 18:30:20 user nova-compute[70375]:     <apic/>
Jul 24 18:30:20 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:30:20 user nova-compute[70375]:   </features>
Jul 24 18:30:20 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:30:20 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:30:20 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:30:20 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:30:20 user nova-compute[70375]:   </clock>
Jul 24 18:30:20 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:30:20 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:30:20 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:30:20 user nova-compute[70375]:   </cpu>
Jul 24 18:30:20 user nova-compute[70375]:   <devices>
Jul 24 18:30:20 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:30:20 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:30:20 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk"/>
Jul 24 18:30:20 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:30:20 user nova-compute[70375]:     </disk>
Jul 24 18:30:20 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:30:20 user nova-compute[70375]:       <mac address="fa:16:3e:e0:8a:3e"/>
Jul 24 18:30:20 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:30:20 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:30:20 user nova-compute[70375]:       <target dev="tap84d84a4a-6c"/>
Jul 24 18:30:20 user nova-compute[70375]:     </interface>
Jul 24 18:30:20 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:30:20 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/console.log" append="off"/>
Jul 24 18:30:20 user nova-compute[70375]:     </serial>
Jul 24 18:30:20 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:30:20 user nova-compute[70375]:     <video>
Jul 24 18:30:20 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:30:20 user nova-compute[70375]:     </video>
Jul 24 18:30:20 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:30:20 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:30:20 user nova-compute[70375]:     </rng>
Jul 24 18:30:20 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:30:20 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:30:20 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:30:20 user nova-compute[70375]:     </memballoon>
Jul 24 18:30:20 user nova-compute[70375]:   </devices>
Jul 24 18:30:20 user nova-compute[70375]: </domain>
Jul 24 18:30:20 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2059777208',display_name='tempest-TestStampPattern-server-2059777208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2059777208',id=50,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-atc3myfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:30:18Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=e792dbd0-3ec4-4b2b-b2c8-45c11e568282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG os_vif [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d84a4a-6c, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d84a4a-6c, col_values=(('external_ids', {'iface-id': '84d84a4a-6c9b-4473-a7b6-a87337d14c68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:8a:3e', 'vm-uuid': 'e792dbd0-3ec4-4b2b-b2c8-45c11e568282'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:20 user nova-compute[70375]: INFO os_vif [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c')
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No VIF found with MAC fa:16:3e:e0:8a:3e, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated VIF entry in instance network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:30:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-63e76470-84fa-41cf-bc66-184908474fa9 req-17e51a43-4658-4d77-81bd-7ee8f0184a9b service nova] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG nova.compute.manager [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] No waiting events found dispatching network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:30:21 user nova-compute[70375]: WARNING nova.compute.manager [req-38cad986-82da-4a36-8aeb-ad3843907635 req-75d8b2ab-d42e-4f93-a5b7-ee77678e6919 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received unexpected event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 for instance with vm_state building and task_state spawning.
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223423.5593114, e792dbd0-3ec4-4b2b-b2c8-45c11e568282 => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] VM Resumed (Lifecycle Event)
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Instance spawned successfully.
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_cdrom_bus of ide {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_disk_bus of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_video_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Found default for hw_vif_model of virtio {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223423.5643318, e792dbd0-3ec4-4b2b-b2c8-45c11e568282 => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] VM Started (Lifecycle Event)
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:23 user nova-compute[70375]: DEBUG nova.compute.manager [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] No waiting events found dispatching network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:30:23 user nova-compute[70375]: WARNING nova.compute.manager [req-dd421eec-df08-4ee5-a43b-09cda40418bb req-d0b1d436-4c43-4f5c-8099-7144c0c4db0d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received unexpected event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 for instance with vm_state building and task_state spawning.
Jul 24 18:30:23 user nova-compute[70375]: INFO nova.compute.manager [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Took 6.18 seconds to build instance.
Jul 24 18:30:23 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-1c090c3d-6f2e-462c-a05f-313daece5e6f tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.277s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:30:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:30:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:49 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:30:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:30:57 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:31:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:05 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:31:06 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:31:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:31:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=24.098873138427734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:31:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:31:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:31:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:31:59 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:32:03 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:32:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:32:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:32:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:32:07 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:32:07 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=24.09827423095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:32:07 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:32:08 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:32:09 user nova-compute[70375]: DEBUG nova.compute.manager [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing instance network info cache due to event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:32:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:32:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:32:09 user nova-compute[70375]: DEBUG nova.network.neutron [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG nova.network.neutron [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated VIF entry in instance network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG nova.network.neutron [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-7302ad47-9223-49f5-b24a-f3b03058efbe req-c799eaa4-3e94-47ce-86b9-e6cd40f1ecf3 service nova] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:32:10 user nova-compute[70375]: INFO nova.compute.manager [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Attaching volume 3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 to /dev/vdb
Jul 24 18:32:10 user nova-compute[70375]: DEBUG os_brick.utils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d629b03-519e-4f07-af89-5b714d4762aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddce926-1052-4321-b342-9fe60986d6c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fda9c-3f1c-4c0a-a82b-7c806e15d9cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f32edb-9645-4f61-a142-cad46d5ad7fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:32:11 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:32:11 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db49f4-af5d-49a7-8215-f952ea246191]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG os_brick.utils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating existing volume attachment record: 16b59ba1-4cff-47f0-8b1e-6dfbfb006470 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usYlzjZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:32:17 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:32:17 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:32:17 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1a12e-92e4-4b53-8efe-2cf7d4407fd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:32:17 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b24d51-faa6-4059-8ff2-79a115856b58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61] added
Jul 24 18:32:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7772e5b8-5b05-45ea-aaf4-e2b77af554ca]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[c451ee74-1c8e-4656-a356-d12416c36658]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usYlzjZQ {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usYlzjZQ" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe05b44-d6e6-43c9-9d7d-936752057696]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usYlzjZQ'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[db99c6ff-975e-423a-b45e-763a4db3cfaa]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf6280-94da-4a6f-a9d3-b274160f66c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:32:17 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:32:17 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:32:17 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 18:32:17 user nova-compute[70375]: 
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf976d8-c1f0-423b-8cc9-095deb3f8564]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260]
Jul 24 18:32:17 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260] successful.
Jul 24 18:32:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0753b-c9bf-41ea-899f-f3115683591e]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cfdac0-4a95-4cc4-85d3-a713f4bef15e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)
Jul 24 18:32:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)
Jul 24 18:32:17 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcab3e39-0717-464a-ae02-6575ad500622]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:32:17 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usYlzjZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26130613262373737', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130613262373737', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.objects.instance [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:32:18 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:32:18 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:32:18 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:32:18 user nova-compute[70375]:   <serial>3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61</serial>
Jul 24 18:32:18 user nova-compute[70375]: </disk>
Jul 24 18:32:18 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:32:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No VIF found with MAC fa:16:3e:e0:8a:3e, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:32:19 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-c5c901ac-24cf-4d3c-a8e6-3905addb0f9a tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.194s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:32:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:32:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:32:20 user nova-compute[70375]: INFO nova.compute.manager [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Detaching volume 3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61
Jul 24 18:32:21 user nova-compute[70375]: INFO nova.virt.block_device [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Attempting to driver detach volume 3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 from mountpoint /dev/vdb
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Attempting to detach device vdb from instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:32:21 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:32:21 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:32:21 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:32:21 user nova-compute[70375]:   <serial>3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61</serial>
Jul 24 18:32:21 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:32:21 user nova-compute[70375]: </disk>
Jul 24 18:32:21 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:32:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully detached device vdb from instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 from the persistent domain config.
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:32:21 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:32:21 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:32:21 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:32:21 user nova-compute[70375]:   <serial>3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61</serial>
Jul 24 18:32:21 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:32:21 user nova-compute[70375]: </disk>
Jul 24 18:32:21 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690223541.4566476, e792dbd0-3ec4-4b2b-b2c8-45c11e568282 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:32:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully detached device vdb from instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 from the live domain config.
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usYlzjZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:32:21 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac4b1f-f392-4cd8-b62e-50ac09e13599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:32:21 user nova-compute[70375]: No targets found.
Jul 24 18:32:21 user nova-compute[70375]: iSNS:
Jul 24 18:32:21 user nova-compute[70375]: No targets found.
Jul 24 18:32:21 user nova-compute[70375]: STATIC:
Jul 24 18:32:21 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61
Jul 24 18:32:21 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:32:21 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:32:21 user nova-compute[70375]: FIRMWARE:
Jul 24 18:32:21 user nova-compute[70375]: No targets found.
Jul 24 18:32:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:32:21 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:32:21 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb115cd4-78d3-47b8-a7aa-8bd593f27b64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[598af675-de80-432f-ba7d-cec6076f3e2a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)
Jul 24 18:32:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 (non-flash)
Jul 24 18:32:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630364c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672f1d8-c703-4ea8-90f0-de6ac29ee577]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c395d5-4797-47c8-822f-99fcadc08a82]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca141b3b-f66b-443f-b903-9a2132441873]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834273d-ff2d-43ca-8b68-0dadcf83be36]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe59609-ce9f-4cbf-b4f8-cc99acad2cb0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e804004-ac42-4b97-929b-270058db0ad9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260]
Jul 24 18:32:21 user nova-compute[70375]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61, portal: 172.16.0.220,3260] successful.
Jul 24 18:32:21 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac8e4fe-87cb-4353-ac68-fab2b6bf0b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b70670-39ef-465b-a2bb-ec043453f77f]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== disconnect_volume: return (278ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:32:21 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:32:22 user nova-compute[70375]: DEBUG nova.objects.instance [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:32:22 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-3ce82b04-3f1e-47c0-9e20-3ccbc2b145da tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:32:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:32:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:32:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:32:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:33:03 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:33:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:33:07 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:07 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:08 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:33:08 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:33:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=24.097171783447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:33:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:16 user nova-compute[70375]: DEBUG nova.compute.manager [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:33:16 user nova-compute[70375]: INFO nova.compute.manager [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] instance snapshotting
Jul 24 18:33:16 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Beginning live snapshot process
Jul 24 18:33:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json -f qcow2 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:16 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f --force-share --output=json" returned: 0 in 0.135s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b.delta 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:17 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3cb808a0e6c8a325374a720d7f8cfe11a4dfb5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b.delta 1073741824" returned: 0 in 0.047s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:17 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 18:33:17 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:33:18 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70375) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 18:33:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 18:33:18 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:33:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b.delta /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:18 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b.delta /opt/stack/data/nova/instances/snapshots/tmp4xynurg4/0268606579e944e3a87d3a7a93ddc35b" returned: 0 in 0.468s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:18 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Snapshot extracted, beginning image upload
Jul 24 18:33:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:33:21 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Snapshot image upload complete
Jul 24 18:33:21 user nova-compute[70375]: INFO nova.compute.manager [None req-ea7722ae-60ce-41b3-8790-e4710f8665c6 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Took 4.77 seconds to snapshot the instance on the hypervisor.
Jul 24 18:33:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Starting instance... {{(pid=70375) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70375) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 18:33:27 user nova-compute[70375]: INFO nova.compute.claims [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Claim successful on node user
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Start building networks asynchronously for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Allocating IP information in the background. {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] allocate_for_instance() {{(pid=70375) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 18:33:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 18:33:27 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Start building block device mappings for instance. {{(pid=70375) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG nova.policy [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07b8862fd05747eb89d991340af7ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76148e944c8e4f518a28afc43b633794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70375) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Start spawning the instance on the hypervisor. {{(pid=70375) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Creating instance directory {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 18:33:28 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Creating image(s)
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "/opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "/opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "1db4317136eff84e5be98efddcb026f991598e02" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "1db4317136eff84e5be98efddcb026f991598e02" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.part --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:28 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Successfully created port: 67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.part --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.virt.images [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] 6b098f5c-9b0a-40ff-8500-edfe3f7ae6da was qcow2, converting to raw {{(pid=70375) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.privsep.utils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70375) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.part /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.converted {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.part /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.converted" returned: 0 in 0.426s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.converted --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "1db4317136eff84e5be98efddcb026f991598e02" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.494s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Successfully updated port: 67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquired lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Building network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.compute.manager [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing instance network info cache due to event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] Acquiring lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json" returned: 0 in 0.136s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "1db4317136eff84e5be98efddcb026f991598e02" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "1db4317136eff84e5be98efddcb026f991598e02" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Instance cache missing network info. {{(pid=70375) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json" returned: 0 in 0.131s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02,backing_fmt=raw /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk 1073741824 {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02,backing_fmt=raw /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk 1073741824" returned: 0 in 0.049s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "1db4317136eff84e5be98efddcb026f991598e02" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:29 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1db4317136eff84e5be98efddcb026f991598e02 --force-share --output=json" returned: 0 in 0.147s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'migration_context' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.neutron [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Created local disks {{(pid=70375) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Ensure instance console log exists: /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/console.log {{(pid=70375) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Releasing lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Instance network_info: |[{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70375) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] Acquired lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Start _get_guest_xml network_info=[{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f2191d743367db5dbd51a40e81d0e959',container_format='bare',created_at=2023-07-24T18:33:16Z,direct_url=<?>,disk_format='qcow2',id=6b098f5c-9b0a-40ff-8500-edfe3f7ae6da,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1526198467',owner='76148e944c8e4f518a28afc43b633794',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T18:33:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'image_id': '6b098f5c-9b0a-40ff-8500-edfe3f7ae6da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 18:33:30 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:33:30 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU controller missing on host. {{(pid=70375) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.host [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU controller found on host. {{(pid=70375) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70375) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T17:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f2191d743367db5dbd51a40e81d0e959',container_format='bare',created_at=2023-07-24T18:33:16Z,direct_url=<?>,disk_format='qcow2',id=6b098f5c-9b0a-40ff-8500-edfe3f7ae6da,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1526198467',owner='76148e944c8e4f518a28afc43b633794',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T18:33:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flavor limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Image limits 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flavor pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Image pref 0:0:0 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Got 1 possible topologies {{(pid=70375) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.hardware [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70375) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-369518941',display_name='tempest-TestStampPattern-server-369518941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-369518941',id=51,image_ref='6b098f5c-9b0a-40ff-8500-edfe3f7ae6da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-dnjaadty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e792dbd0-3ec4-4b2b-b2c8-45c11e568282',image_min_disk='1',image_min_ram='0',image_owner_id='76148e944c8e4f518a28afc43b633794',image_owner_project_name='tempest-TestStampPattern-2111286489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2111286489-project-member',image_user_id='07b8862fd05747eb89d991340af7ca10',network_allocated='True',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:33:28Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=d6612e9d-de8b-41ed-b3d2-25be5123971a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70375) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.objects.instance [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'pci_devices' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 18:33:30 user nova-compute[70375]:   <uuid>d6612e9d-de8b-41ed-b3d2-25be5123971a</uuid>
Jul 24 18:33:30 user nova-compute[70375]:   <name>instance-00000033</name>
Jul 24 18:33:30 user nova-compute[70375]:   <memory>524288</memory>
Jul 24 18:33:30 user nova-compute[70375]:   <vcpu>1</vcpu>
Jul 24 18:33:30 user nova-compute[70375]:   <metadata>
Jul 24 18:33:30 user nova-compute[70375]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 18:33:30 user nova-compute[70375]:       <nova:package version="0.0.0"/>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:name>tempest-TestStampPattern-server-369518941</nova:name>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:creationTime>2023-07-24 18:33:30</nova:creationTime>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:flavor name="m1.tiny">
Jul 24 18:33:30 user nova-compute[70375]:         <nova:memory>512</nova:memory>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:disk>1</nova:disk>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:swap>0</nova:swap>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:vcpus>1</nova:vcpus>
Jul 24 18:33:30 user nova-compute[70375]:       </nova:flavor>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:owner>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:user uuid="07b8862fd05747eb89d991340af7ca10">tempest-TestStampPattern-2111286489-project-member</nova:user>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:project uuid="76148e944c8e4f518a28afc43b633794">tempest-TestStampPattern-2111286489</nova:project>
Jul 24 18:33:30 user nova-compute[70375]:       </nova:owner>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:root type="image" uuid="6b098f5c-9b0a-40ff-8500-edfe3f7ae6da"/>
Jul 24 18:33:30 user nova-compute[70375]:       <nova:ports>
Jul 24 18:33:30 user nova-compute[70375]:         <nova:port uuid="67f4538d-2569-4356-ba3d-2910a3ad223b">
Jul 24 18:33:30 user nova-compute[70375]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 18:33:30 user nova-compute[70375]:         </nova:port>
Jul 24 18:33:30 user nova-compute[70375]:       </nova:ports>
Jul 24 18:33:30 user nova-compute[70375]:     </nova:instance>
Jul 24 18:33:30 user nova-compute[70375]:   </metadata>
Jul 24 18:33:30 user nova-compute[70375]:   <sysinfo type="smbios">
Jul 24 18:33:30 user nova-compute[70375]:     <system>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="product">OpenStack Nova</entry>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="version">0.0.0</entry>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="serial">d6612e9d-de8b-41ed-b3d2-25be5123971a</entry>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="uuid">d6612e9d-de8b-41ed-b3d2-25be5123971a</entry>
Jul 24 18:33:30 user nova-compute[70375]:       <entry name="family">Virtual Machine</entry>
Jul 24 18:33:30 user nova-compute[70375]:     </system>
Jul 24 18:33:30 user nova-compute[70375]:   </sysinfo>
Jul 24 18:33:30 user nova-compute[70375]:   <os>
Jul 24 18:33:30 user nova-compute[70375]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 18:33:30 user nova-compute[70375]:     <boot dev="hd"/>
Jul 24 18:33:30 user nova-compute[70375]:     <smbios mode="sysinfo"/>
Jul 24 18:33:30 user nova-compute[70375]:   </os>
Jul 24 18:33:30 user nova-compute[70375]:   <features>
Jul 24 18:33:30 user nova-compute[70375]:     <acpi/>
Jul 24 18:33:30 user nova-compute[70375]:     <apic/>
Jul 24 18:33:30 user nova-compute[70375]:     <vmcoreinfo/>
Jul 24 18:33:30 user nova-compute[70375]:   </features>
Jul 24 18:33:30 user nova-compute[70375]:   <clock offset="utc">
Jul 24 18:33:30 user nova-compute[70375]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 18:33:30 user nova-compute[70375]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 18:33:30 user nova-compute[70375]:     <timer name="hpet" present="no"/>
Jul 24 18:33:30 user nova-compute[70375]:   </clock>
Jul 24 18:33:30 user nova-compute[70375]:   <cpu mode="custom" match="exact">
Jul 24 18:33:30 user nova-compute[70375]:     <model>Nehalem</model>
Jul 24 18:33:30 user nova-compute[70375]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 18:33:30 user nova-compute[70375]:   </cpu>
Jul 24 18:33:30 user nova-compute[70375]:   <devices>
Jul 24 18:33:30 user nova-compute[70375]:     <disk type="file" device="disk">
Jul 24 18:33:30 user nova-compute[70375]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 18:33:30 user nova-compute[70375]:       <source file="/opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk"/>
Jul 24 18:33:30 user nova-compute[70375]:       <target dev="vda" bus="virtio"/>
Jul 24 18:33:30 user nova-compute[70375]:     </disk>
Jul 24 18:33:30 user nova-compute[70375]:     <interface type="ethernet">
Jul 24 18:33:30 user nova-compute[70375]:       <mac address="fa:16:3e:b2:b6:10"/>
Jul 24 18:33:30 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:33:30 user nova-compute[70375]:       <mtu size="1442"/>
Jul 24 18:33:30 user nova-compute[70375]:       <target dev="tap67f4538d-25"/>
Jul 24 18:33:30 user nova-compute[70375]:     </interface>
Jul 24 18:33:30 user nova-compute[70375]:     <serial type="pty">
Jul 24 18:33:30 user nova-compute[70375]:       <log file="/opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/console.log" append="off"/>
Jul 24 18:33:30 user nova-compute[70375]:     </serial>
Jul 24 18:33:30 user nova-compute[70375]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 18:33:30 user nova-compute[70375]:     <video>
Jul 24 18:33:30 user nova-compute[70375]:       <model type="virtio"/>
Jul 24 18:33:30 user nova-compute[70375]:     </video>
Jul 24 18:33:30 user nova-compute[70375]:     <rng model="virtio">
Jul 24 18:33:30 user nova-compute[70375]:       <backend model="random">/dev/urandom</backend>
Jul 24 18:33:30 user nova-compute[70375]:     </rng>
Jul 24 18:33:30 user nova-compute[70375]:     <controller type="usb" index="0" model="none"/>
Jul 24 18:33:30 user nova-compute[70375]:     <memballoon model="virtio">
Jul 24 18:33:30 user nova-compute[70375]:       <stats period="10"/>
Jul 24 18:33:30 user nova-compute[70375]:     </memballoon>
Jul 24 18:33:30 user nova-compute[70375]:   </devices>
Jul 24 18:33:30 user nova-compute[70375]: </domain>
Jul 24 18:33:30 user nova-compute[70375]:  {{(pid=70375) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-369518941',display_name='tempest-TestStampPattern-server-369518941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-369518941',id=51,image_ref='6b098f5c-9b0a-40ff-8500-edfe3f7ae6da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-dnjaadty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e792dbd0-3ec4-4b2b-b2c8-45c11e568282',image_min_disk='1',image_min_ram='0',image_owner_id='76148e944c8e4f518a28afc43b633794',image_owner_project_name='tempest-TestStampPattern-2111286489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2111286489-project-member',image_user_id='07b8862fd05747eb89d991340af7ca10',network_allocated='True',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T18:33:28Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=d6612e9d-de8b-41ed-b3d2-25be5123971a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG os_vif [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25') {{(pid=70375) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f4538d-25, may_exist=True, interface_attrs={}) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f4538d-25, col_values=(('external_ids', {'iface-id': '67f4538d-2569-4356-ba3d-2910a3ad223b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:b6:10', 'vm-uuid': 'd6612e9d-de8b-41ed-b3d2-25be5123971a'}),), if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:30 user nova-compute[70375]: INFO os_vif [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25')
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No VIF found with MAC fa:16:3e:b2:b6:10, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updated VIF entry in instance network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG nova.network.neutron [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:33:30 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-1a418759-0418-4ec0-8318-8617858b8aa1 req-0d30956c-f0b9-421c-858f-62a35380ab95 service nova] Releasing lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:31 user nova-compute[70375]: DEBUG nova.compute.manager [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] No waiting events found dispatching network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:33:31 user nova-compute[70375]: WARNING nova.compute.manager [req-99f94cb6-abce-4041-90e2-d2015bbbdb2f req-c8d8576d-ae89-4336-ab1a-ed12db161c55 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received unexpected event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b for instance with vm_state building and task_state spawning.
Jul 24 18:33:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223613.6846647, d6612e9d-de8b-41ed-b3d2-25be5123971a => Resumed> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] VM Resumed (Lifecycle Event)
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Instance event wait completed in 0 seconds for  {{(pid=70375) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Guest created on hypervisor {{(pid=70375) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Instance spawned successfully.
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Found default for hw_input_bus of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Found default for hw_pointer_model of None {{(pid=70375) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.virt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Emitting event <LifecycleEvent: 1690223613.6874125, d6612e9d-de8b-41ed-b3d2-25be5123971a => Started> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] VM Started (Lifecycle Event)
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70375) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 18:33:33 user nova-compute[70375]: INFO nova.compute.manager [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Took 6.28 seconds to build instance.
Jul 24 18:33:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-b45a11f3-e490-4084-989f-035094e3271d tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.373s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:33:33 user nova-compute[70375]: DEBUG nova.compute.manager [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] No waiting events found dispatching network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:33:33 user nova-compute[70375]: WARNING nova.compute.manager [req-db2aba3f-985c-4895-9ea0-ca92c26eacad req-1a6993d8-7dc3-4ea3-ba1b-e4bda8a73029 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received unexpected event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b for instance with vm_state active and task_state None.
Jul 24 18:33:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:33:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:33:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:52 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:33:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 18:33:52 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] There are 0 instances to clean {{(pid=70375) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 18:33:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:33:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:02 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:02 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:34:03 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:34:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:34:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:34:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:34:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=23.950958251953125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d6612e9d-de8b-41ed-b3d2-25be5123971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:14 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:24 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:34:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:34:39 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:39 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Cleaning up deleted instances with incomplete migration  {{(pid=70375) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:34:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:34:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:34:53 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:34:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_power_states {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Triggering sync for uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:01 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:04 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:04 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:35:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:08 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:09 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:35:09 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=23.95026397705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d6612e9d-de8b-41ed-b3d2-25be5123971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing inventories for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating ProviderTree inventory for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Updating inventory in ProviderTree for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing aggregate associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, aggregates: None {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Refreshing trait associations for resource provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC {{(pid=70375) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:35:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:35:10 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:11 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:18 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.compute.manager [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing instance network info cache due to event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] Acquiring lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] Acquired lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updated VIF entry in instance network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG nova.network.neutron [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-720a7825-35f8-44f2-8b23-3ab490d728e5 req-bdc2ebf3-0dfc-4685-89ad-95bdd0c85feb service nova] Releasing lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:20 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:20 user nova-compute[70375]: INFO nova.compute.manager [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Attaching volume 6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd to /dev/vdb
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.utils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8e81e-5afd-426d-8046-e11b84ef857d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a28dc98912e8\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f859c4-7c48-4b2a-80c8-c603f52e4d08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9682e4cb-6f5f-4723-b6ad-0ea8ca688be0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee83113-4150-4cb9-9e19-852a12765642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Running cmd (subprocess): nvme version {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] 'nvme version' failed. Not Retrying. {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] nvme not present on system {{(pid=70375) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 18:35:21 user nova-compute[70375]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 18:35:21 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[4532705e-f7b0-47b8-bc4f-32d43cb06501]: (4, '') {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70375) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.lightos [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] LIGHTOS: no hostnqn found. {{(pid=70375) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG os_brick.utils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a28dc98912e8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG nova.virt.block_device [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating existing volume attachment record: d0abcf15-65e2-4e89-8775-5fd07b76ae58 {{(pid=70375) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 18:35:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:30 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Calling os-brick to attach iSCSI Volume {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQyWvGEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:35:31 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:35:31 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:35:31 user nova-compute[70375]: INFO os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e14e0-9455-413d-9140-16725263d7ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 18:35:31 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --interface default --op new {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[56376faa-ab02-4c3f-a627-83335f264663]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd] added\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd] added
Jul 24 18:35:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a707a27-f4a6-4a5e-8906-56e514b9457b]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ea525-efb4-46c4-9ae8-2209f96bda34]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQyWvGEL {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQyWvGEL" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fd175b-019c-4c10-9b84-76cda96c35c5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VQyWvGEL'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcaf12f-2d55-4154-855d-4025291644f5]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272f899-7905-49cb-b560-05e7a99d9751]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:35:31 user nova-compute[70375]:  {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 18:35:31 user nova-compute[70375]:  {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:35:31 user nova-compute[70375]: WARNING os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 18:35:31 user nova-compute[70375]: 
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --login {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724d672-18d1-415e-9e34-38b6b833a5b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260]
Jul 24 18:35:31 user nova-compute[70375]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260] successful.
Jul 24 18:35:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[181542de-ee75-4778-8e84-57be42006ddf]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be7d025-49da-44b6-813d-da968006e2d4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)
Jul 24 18:35:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)
Jul 24 18:35:31 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Connected to 172.16.0.220:3260 {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=70375) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70375) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a5cbe-6395-4a5c-8129-b55bdd49cc04]: (4, ('- - 0', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70375) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQyWvGEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70375) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 18:35:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23736356265313537', 'path': '/dev/sdb'} {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736356265313537', 'path': '/dev/sdb'} {{(pid=70375) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 18:35:32 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:35:32 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:35:32 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:35:32 user nova-compute[70375]:   <serial>6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd</serial>
Jul 24 18:35:32 user nova-compute[70375]: </disk>
Jul 24 18:35:32 user nova-compute[70375]:  {{(pid=70375) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vda, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70375) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 18:35:32 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] No VIF found with MAC fa:16:3e:b2:b6:10, not building metadata {{(pid=70375) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 18:35:33 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7a211b3b-23b4-4ab9-8423-184e86338051 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.083s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:35:35 user nova-compute[70375]: INFO nova.compute.manager [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Detaching volume 6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd
Jul 24 18:35:35 user nova-compute[70375]: INFO nova.virt.block_device [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Attempting to driver detach volume 6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd from mountpoint /dev/vdb
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Attempting to detach device vdb from instance d6612e9d-de8b-41ed-b3d2-25be5123971a from the persistent domain config. {{(pid=70375) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:35:35 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:35:35 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:35:35 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:35:35 user nova-compute[70375]:   <serial>6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd</serial>
Jul 24 18:35:35 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:35:35 user nova-compute[70375]: </disk>
Jul 24 18:35:35 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:35:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully detached device vdb from instance d6612e9d-de8b-41ed-b3d2-25be5123971a from the persistent domain config.
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6612e9d-de8b-41ed-b3d2-25be5123971a from the live domain config. {{(pid=70375) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.guest [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 18:35:35 user nova-compute[70375]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 18:35:35 user nova-compute[70375]:   <source dev="/dev/sdb"/>
Jul 24 18:35:35 user nova-compute[70375]:   <target dev="vdb" bus="virtio"/>
Jul 24 18:35:35 user nova-compute[70375]:   <serial>6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd</serial>
Jul 24 18:35:35 user nova-compute[70375]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 18:35:35 user nova-compute[70375]: </disk>
Jul 24 18:35:35 user nova-compute[70375]:  {{(pid=70375) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-9b1bc6f8-f7cd-4bf6-b41b-37700da288a2 None None] Received event <DeviceRemovedEvent: 1690223735.5303552, d6612e9d-de8b-41ed-b3d2-25be5123971a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70375) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.driver [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 18:35:35 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully detached device vdb from instance d6612e9d-de8b-41ed-b3d2-25be5123971a from the live domain config.
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] calling os-brick to detach iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe648226e90>, {'target_iqn': 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQyWvGEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 18:35:35 user nova-compute[70375]: WARNING os_brick.initiator.connectors.base [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[51006aa5-1828-4213-ba45-6116d7a1ab1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 18:35:35 user nova-compute[70375]: No targets found.
Jul 24 18:35:35 user nova-compute[70375]: iSNS:
Jul 24 18:35:35 user nova-compute[70375]: No targets found.
Jul 24 18:35:35 user nova-compute[70375]: STATIC:
Jul 24 18:35:35 user nova-compute[70375]: Target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd
Jul 24 18:35:35 user nova-compute[70375]:         Portal: 172.16.0.220:3260,-1
Jul 24 18:35:35 user nova-compute[70375]:                 Iface Name: default
Jul 24 18:35:35 user nova-compute[70375]: FIRMWARE:
Jul 24 18:35:35 user nova-compute[70375]: No targets found.
Jul 24 18:35:35 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 18:35:35 user nova-compute[70375]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 18:35:35 user nova-compute[70375]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70375) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd', 0)] {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cacee6-f3e5-42ed-b086-38390d6d4a4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268e235-a873-459c-861a-523475ba5f9b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)
Jul 24 18:35:35 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd (non-flash)
Jul 24 18:35:35 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe630367400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd'): ({'sdb'}, set())}) {{(pid=70375) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Removing single pathed devices sdb {{(pid=70375) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96614c-709c-4241-b6f7-70a4835c78a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f74b4a-a5bb-42c6-b974-a7c13e66511a]: (4, ('ok\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Flushing IO for device /dev/sdb {{(pid=70375) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28864a-c2b1-4724-80a7-fba8647c09ec]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70375) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd46ce2-58b3-44fc-870f-9bacc4b49eb2]: (4, ('1', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.linuxscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] SCSI volumes sdb have been removed. {{(pid=70375) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd')] {{(pid=70375) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb1f60f-6f35-49b9-a417-d2726395cad0]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --logout {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502cf64-88c2-4b42-a80c-986cd4c67801]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260]
Jul 24 18:35:35 user nova-compute[70375]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd, portal: 172.16.0.220,3260] successful.
Jul 24 18:35:35 user nova-compute[70375]:  stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op delete {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3d28a5-a3a7-46c2-8712-26a02e2b6bbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81399) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e9029-4fd6-4350-a39e-9000b75579d2]: (4, ('', '')) {{(pid=81399) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70375) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.base [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] <== disconnect_volume: return (280ms) None {{(pid=70375) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 18:35:35 user nova-compute[70375]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Disconnected iSCSI Volume {{(pid=70375) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 18:35:36 user nova-compute[70375]: DEBUG nova.objects.instance [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'flavor' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:35:36 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-6b74d2e6-0367-46ec-853d-8e5455bfe140 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.550s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:35:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:40 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:45 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:50 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:35:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:35:54 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:35:55 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:00 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:05 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:06 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:36:09 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:36:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:36:10 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=23.949142456054688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance d6612e9d-de8b-41ed-b3d2-25be5123971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:36:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Forcefully refreshing network info cache for instance {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 18:36:12 user nova-compute[70375]: DEBUG nova.objects.instance [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lazy-loading 'info_cache' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG nova.network.neutron [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated the network info_cache for instance {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:15 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:16 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:36:20 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG nova.compute.manager [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing instance network info cache due to event network-changed-67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] Acquiring lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] Acquired lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:36:25 user nova-compute[70375]: DEBUG nova.network.neutron [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Refreshing network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:26 user nova-compute[70375]: INFO nova.compute.manager [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Terminating instance
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Instance destroyed successfully.
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.objects.instance [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'resources' on Instance uuid d6612e9d-de8b-41ed-b3d2-25be5123971a {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-369518941',display_name='tempest-TestStampPattern-server-369518941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-369518941',id=51,image_ref='6b098f5c-9b0a-40ff-8500-edfe3f7ae6da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-dnjaadty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e792dbd0-3ec4-4b2b-b2c8-45c11e568282',image_min_disk='1',image_min_ram='0',image_owner_id='76148e944c8e4f518a28afc43b633794',image_owner_project_name='tempest-TestStampPattern-2111286489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2111286489-project-member',image_user_id='07b8862fd05747eb89d991340af7ca10',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:33:34Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=d6612e9d-de8b-41ed-b3d2-25be5123971a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG os_vif [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f4538d-25, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:26 user nova-compute[70375]: INFO os_vif [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b6:10,bridge_name='br-int',has_traffic_filtering=True,id=67f4538d-2569-4356-ba3d-2910a3ad223b,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f4538d-25')
Jul 24 18:36:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Deleting instance files /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a_del
Jul 24 18:36:26 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Deletion of /opt/stack/data/nova/instances/d6612e9d-de8b-41ed-b3d2-25be5123971a_del complete
Jul 24 18:36:26 user nova-compute[70375]: INFO nova.compute.manager [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 24 18:36:26 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:36:26 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.network.neutron [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updated VIF entry in instance network info cache for port 67f4538d-2569-4356-ba3d-2910a3ad223b. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.network.neutron [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [{"id": "67f4538d-2569-4356-ba3d-2910a3ad223b", "address": "fa:16:3e:b2:b6:10", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f4538d-25", "ovs_interfaceid": "67f4538d-2569-4356-ba3d-2910a3ad223b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-a9a09a1e-b4d8-476f-b2ba-da6364cf8e19 req-c73e5985-d8ba-4c53-bc86-b04f2aca93c4 service nova] Releasing lock "refresh_cache-d6612e9d-de8b-41ed-b3d2-25be5123971a" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:36:27 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Took 0.90 seconds to deallocate network for instance.
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-53f31e4c-0021-49fc-80f1-e06dc1b3051e req-dd4038be-beb9-4d1a-820f-4a7b571a9659 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-vif-deleted-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:36:27 user nova-compute[70375]: INFO nova.compute.manager [req-53f31e4c-0021-49fc-80f1-e06dc1b3051e req-dd4038be-beb9-4d1a-820f-4a7b571a9659 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Neutron deleted interface 67f4538d-2569-4356-ba3d-2910a3ad223b; detaching it from the instance and deleting it from the info cache
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.network.neutron [req-53f31e4c-0021-49fc-80f1-e06dc1b3051e req-dd4038be-beb9-4d1a-820f-4a7b571a9659 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-53f31e4c-0021-49fc-80f1-e06dc1b3051e req-dd4038be-beb9-4d1a-820f-4a7b571a9659 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Detach interface failed, port_id=67f4538d-2569-4356-ba3d-2910a3ad223b, reason: Instance d6612e9d-de8b-41ed-b3d2-25be5123971a could not be found. {{(pid=70375) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-vif-unplugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] No waiting events found dispatching network-vif-unplugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:36:28 user nova-compute[70375]: WARNING nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received unexpected event network-vif-unplugged-67f4538d-2569-4356-ba3d-2910a3ad223b for instance with vm_state deleted and task_state None.
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Acquiring lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] No waiting events found dispatching network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:36:28 user nova-compute[70375]: WARNING nova.compute.manager [req-5cae70c2-cfb7-4aef-8f08-d421cee8a698 req-902f0d21-bef3-4410-b0b5-7a65b0d718a0 service nova] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Received unexpected event network-vif-plugged-67f4538d-2569-4356-ba3d-2910a3ad223b for instance with vm_state deleted and task_state None.
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:28 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Deleted allocations for instance d6612e9d-de8b-41ed-b3d2-25be5123971a
Jul 24 18:36:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-83964383-b673-48db-922f-49dff8426ffb tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "d6612e9d-de8b-41ed-b3d2-25be5123971a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:36:31 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:36 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:41 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690223786.8495054, d6612e9d-de8b-41ed-b3d2-25be5123971a => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:36:41 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] VM Stopped (Lifecycle Event)
Jul 24 18:36:41 user nova-compute[70375]: DEBUG nova.compute.manager [None req-24ddce3a-d4d8-4b41-9e8e-ed03bd57170c None None] [instance: d6612e9d-de8b-41ed-b3d2-25be5123971a] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:36:41 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:46 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:36:51 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:36:56 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:36:56 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:01 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:06 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:06 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:07 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:08 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 18:37:10 user nova-compute[70375]: DEBUG oslo_concurrency.processutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70375) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 18:37:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:37:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=23.949718475341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70375) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:11 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:12 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:12 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:37:13 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:37:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:37:16 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:21 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:25 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing instance network info cache due to event network-changed-84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] Acquiring lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] Acquired lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.network.neutron [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Refreshing network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:26 user nova-compute[70375]: INFO nova.compute.manager [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Terminating instance
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Start destroying the instance on the hypervisor. {{(pid=70375) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-unplugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] No waiting events found dispatching network-vif-unplugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.compute.manager [req-f38319ab-f7bf-4c1e-ab80-b12c2993306f req-42da144f-1862-4381-a562-62176b3a9626 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-unplugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 for instance with task_state deleting. {{(pid=70375) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.network.neutron [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updated VIF entry in instance network info cache for port 84d84a4a-6c9b-4473-a7b6-a87337d14c68. {{(pid=70375) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG nova.network.neutron [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [{"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-85289938-da61-47d2-bba2-ed3992f4b944 req-ccaf93a3-24b6-4be6-9a28-ad7cd28d5938 service nova] Releasing lock "refresh_cache-e792dbd0-3ec4-4b2b-b2c8-45c11e568282" {{(pid=70375) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:26 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Instance destroyed successfully.
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.objects.instance [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lazy-loading 'resources' on Instance uuid e792dbd0-3ec4-4b2b-b2c8-45c11e568282 {{(pid=70375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.virt.libvirt.vif [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T18:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2059777208',display_name='tempest-TestStampPattern-server-2059777208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2059777208',id=50,image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+E0rR8jSumnD+agq+NdT3LA2Si4hTHRaCh2gnJxIK+ktcLbOyt9yfDNWGUxSFT3JLPtEx6vBV7n4clU+8HwaXUHKqqdbFppFClY8YCxqjY8k5MR0nJj361zZOjk1FVow==',key_name='tempest-TestStampPattern-570203464',keypairs=<?>,launch_index=0,launched_at=2023-07-24T18:30:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76148e944c8e4f518a28afc43b633794',ramdisk_id='',reservation_id='r-atc3myfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e95aac-d02a-49a8-aaa5-04490973ed39',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2111286489',owner_user_name='tempest-TestStampPattern-2111286489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T18:33:21Z,user_data=None,user_id='07b8862fd05747eb89d991340af7ca10',uuid=e792dbd0-3ec4-4b2b-b2c8-45c11e568282,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converting VIF {"id": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "address": "fa:16:3e:e0:8a:3e", "network": {"id": "191f8499-2e1e-4f81-bc30-d62c6f87061f", "bridge": "br-int", "label": "tempest-TestStampPattern-1388424244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76148e944c8e4f518a28afc43b633794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d84a4a-6c", "ovs_interfaceid": "84d84a4a-6c9b-4473-a7b6-a87337d14c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.network.os_vif_util [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c') {{(pid=70375) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG os_vif [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c') {{(pid=70375) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d84a4a-6c, bridge=br-int, if_exists=True) {{(pid=70375) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:27 user nova-compute[70375]: INFO os_vif [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:8a:3e,bridge_name='br-int',has_traffic_filtering=True,id=84d84a4a-6c9b-4473-a7b6-a87337d14c68,network=Network(191f8499-2e1e-4f81-bc30-d62c6f87061f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d84a4a-6c')
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Deleting instance files /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282_del
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.virt.libvirt.driver [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Deletion of /opt/stack/data/nova/instances/e792dbd0-3ec4-4b2b-b2c8-45c11e568282_del complete
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.compute.manager [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 24 18:37:27 user nova-compute[70375]: DEBUG oslo.service.loopingcall [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70375) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.compute.manager [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Deallocating network for instance {{(pid=70375) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] deallocate_for_instance() {{(pid=70375) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.network.neutron [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Updating instance_info_cache with network_info: [] {{(pid=70375) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Took 0.46 seconds to deallocate network for instance.
Jul 24 18:37:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.compute.manager [req-114578f0-58ed-4319-a3a1-a0a1a6d9f90a req-ae72e3e8-a1f5-4415-b61b-20ec062393dc service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-deleted-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:37:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:27 user nova-compute[70375]: INFO nova.scheduler.client.report [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Deleted allocations for instance e792dbd0-3ec4-4b2b-b2c8-45c11e568282
Jul 24 18:37:27 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-7dbcc491-b2ba-469d-ab72-71193163ea27 tempest-TestStampPattern-2111286489 tempest-TestStampPattern-2111286489-project-member] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.610s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 18:37:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] Acquiring lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:37:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:37:28 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] Lock "e792dbd0-3ec4-4b2b-b2c8-45c11e568282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:37:28 user nova-compute[70375]: DEBUG nova.compute.manager [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] No waiting events found dispatching network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 {{(pid=70375) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 18:37:28 user nova-compute[70375]: WARNING nova.compute.manager [req-8080589f-229f-44eb-8819-2680d9908536 req-d8614404-1cd2-4903-9460-16896d41a38d service nova] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Received unexpected event network-vif-plugged-84d84a4a-6c9b-4473-a7b6-a87337d14c68 for instance with vm_state deleted and task_state None.
Jul 24 18:37:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:41 user nova-compute[70375]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690223846.9965382, e792dbd0-3ec4-4b2b-b2c8-45c11e568282 => Stopped> {{(pid=70375) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 18:37:41 user nova-compute[70375]: INFO nova.compute.manager [-] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] VM Stopped (Lifecycle Event)
Jul 24 18:37:42 user nova-compute[70375]: DEBUG nova.compute.manager [None req-3b057345-4d4d-409b-9071-fda2d2e6ad86 None None] [instance: e792dbd0-3ec4-4b2b-b2c8-45c11e568282] Checking state {{(pid=70375) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:37:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:37:57 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:02 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:07 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:07 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:08 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:10 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:10 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70375) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager.update_available_resource {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Auditing locally available compute resources for user (node: user) {{(pid=70375) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 18:38:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:38:11 user nova-compute[70375]: WARNING nova.virt.libvirt.driver [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=24.0743408203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70375) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70375) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.provider_tree [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed in ProviderTree for provider: 111dfe89-23fd-4eb8-8c78-beab50e50b4c {{(pid=70375) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.scheduler.client.report [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Inventory has not changed for provider 111dfe89-23fd-4eb8-8c78-beab50e50b4c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70375) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG nova.compute.resource_tracker [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Compute_service record updated for user:user {{(pid=70375) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 18:38:11 user nova-compute[70375]: DEBUG oslo_concurrency.lockutils [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=70375) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 18:38:12 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:13 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:14 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Starting heal instance info cache {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 18:38:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Rebuilding the list of instances to heal {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 18:38:14 user nova-compute[70375]: DEBUG nova.compute.manager [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Didn't find any instances for network info cache update. {{(pid=70375) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 18:38:14 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:38:17 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:19 user nova-compute[70375]: DEBUG oslo_service.periodic_task [None req-11742ac3-4034-4486-9b4d-bf85e170a15f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70375) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 18:38:22 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:24 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:27 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:32 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 18:38:37 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:42 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70375) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70375) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 18:38:47 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 18:38:52 user nova-compute[70375]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=70375) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}